-- Logs begin at Wed 2022-08-24 08:44:50 UTC, end at Wed 2022-08-24 09:57:46 UTC. -- Aug 24 09:16:50.489341 dv-cinder-854269-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 09:16:50.496719 dv-cinder-854269-2-smb devstack@keystone.service[81571]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 09:16:50 2022] *** Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: nodename: dv-cinder-854269-2-smb Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: machine: x86_64 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: clock source: unix Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: pcre jit disabled Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: detected number of CPU cores: 4 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: current working directory: / Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: detected binary path: /usr/bin/uwsgi-core Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: your processes number limit is 47680 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: your memory page size is 4096 bytes Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: detected max file descriptor number: 2048 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: lock engine: pthread robust mutexes Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: thunder lock: enabled Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 09:16:50.501155 dv-cinder-854269-2-smb devstack@keystone.service[81571]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 09:16:50.540298 dv-cinder-854269-2-smb devstack@keystone.service[81571]: Python main interpreter initialized at 0x55702b3e29c0 Aug 24 09:16:50.540298 dv-cinder-854269-2-smb devstack@keystone.service[81571]: python threads support enabled Aug 24 09:16:50.540298 dv-cinder-854269-2-smb devstack@keystone.service[81571]: your server socket listen backlog is limited to 100 connections Aug 24 09:16:50.540298 dv-cinder-854269-2-smb devstack@keystone.service[81571]: your mercy for graceful operations on workers is 90 seconds Aug 24 09:16:50.540673 dv-cinder-854269-2-smb devstack@keystone.service[81571]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 09:16:50.540751 dv-cinder-854269-2-smb devstack@keystone.service[81571]: *** Operational MODE: preforking *** Aug 24 09:16:50.540989 dv-cinder-854269-2-smb devstack@keystone.service[81571]: *** uWSGI is running in multiple interpreter mode *** Aug 24 09:16:50.540989 dv-cinder-854269-2-smb devstack@keystone.service[81571]: spawned uWSGI master process (pid: 81571) Aug 24 09:16:50.541194 dv-cinder-854269-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 09:16:50.545889 dv-cinder-854269-2-smb devstack@keystone.service[81571]: spawned uWSGI worker 1 (pid: 81583, cores: 1) Aug 24 09:16:50.545889 dv-cinder-854269-2-smb devstack@keystone.service[81571]: spawned uWSGI worker 2 (pid: 81584, cores: 1) Aug 24 09:16:50.545889 dv-cinder-854269-2-smb devstack@keystone.service[81571]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 09:16:54.861717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:16:54.861717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Aug 24 09:16:54.862479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:16:54.862479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Aug 24 09:16:54.864962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:16:54.864962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: from cryptography.utils import int_from_bytes Aug 24 09:16:54.865419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:16:54.865419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: from cryptography.utils import int_from_bytes Aug 24 09:16:54.923979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:16:54.924174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:16:54.924328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] command line args: [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:16:54.924583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:16:54.924679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:16:54.924760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ================================================================================ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:16:54.924843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:16:54.924957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] command line args: [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:16:54.925042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] admin_token = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config_dir = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:16:54.925377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ================================================================================ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:16:54.925458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] config_source = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] debug = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_dir = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.925977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] config_source = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] debug = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.926994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_config_append = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_dir = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.927931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_config_append = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_dir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.928981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.929950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930565 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.930951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.931941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] publish_errors = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] publish_errors = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.932955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] standard_threads = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.933945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] standard_threads = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_journal = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_json = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_journal = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.934974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_json = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_stderr = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_stderr = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] use_syslog = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] use_syslog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:16:54.935570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.935696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.935782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.935930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.936994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.937989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.938936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.939913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.940891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.941987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.942935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.943956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.944106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.944189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.944322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.944399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.944554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.944635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.945313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.945404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.945678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.945803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.945977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.946065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.946137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.948429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.948552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.948631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.948748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.948851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.948949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.949972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.950945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.951892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.952981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.953946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.954933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.955947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.956768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.957925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.958995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.959990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.960075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.960253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.960378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.961159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.961370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.961465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.external = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.961628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.961707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.external = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.961919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.password = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.token = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.password = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.962972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.token = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.963907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.964999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.965877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.966971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.967843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.968963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969519 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.969940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.970039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.970173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.970256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.971982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.972965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.973986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.974953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.975946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.976145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.976225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.976457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.976600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.976726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.976930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.977953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978040 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.978995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.979947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.980874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.981990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.982931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.983907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.984959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985682 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.985978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.986867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.987963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.988988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.989921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.990928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.991932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.992933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.993971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.994913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.995835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996498 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.996986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.997965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.998929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:54.999818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.000846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001582 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.001818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.002213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.002308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.002384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.002457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.002530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.005917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.005917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.006937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.007966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.008992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.009990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.010982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.011974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012555 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.012978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:16:55.013141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.013370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.013609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.013843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:16:55.014035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:16:55.042868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.043090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.043313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.043431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.043664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.043888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.051800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.052459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.082812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.082982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.083070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.083212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.137170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.137611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.194481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.194750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.195919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.196150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.362887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.363018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.363100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.363231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.363322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.363444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.386932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.387944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.398921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.399555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.412935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.413020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.413152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.413239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.413362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.413503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.414253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.414434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:16:55.430874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.431081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:16:55.431421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.431623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:16:55.431901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.432001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.432138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:16:55.432222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.432476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.432660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.432742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:16:55.432925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.433010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.433188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.433694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.433991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.442352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.442631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.442901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.443188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.443272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.443647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.443930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.444213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.450794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.451999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.453689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.453998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.454284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.454569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.454855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.454937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.455119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.455205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.455391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.455474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.455667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.455758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.455981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.456062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.456245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.456326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.456517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.456608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.456792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.457543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.457828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.458126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.480501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.481998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.482255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.482340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.483693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.483972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.486952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.487236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.487521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.488623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.488907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.489187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.493930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.494218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.495886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.496166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.500895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.500895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.500895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.500895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.500895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.500895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.501373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.501960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.502228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.517692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.517997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.520135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.520414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.521878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.525238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.525642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.525968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.528485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.528794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.530177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.533012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.533309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.536194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.536557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.536857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.537144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.537433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.537726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.538049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.540335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.540629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.540914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.541305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.541593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.541902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.555041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.555339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.555605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.555869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.558561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.558861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.559129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.559397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.562795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.564330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.564609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.566440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.567287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.567587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.567869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.567976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.568161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.568247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.568440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.571151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.571436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.571767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.572062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.572339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.580170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.580454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.580737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.581014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.581294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.581577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.582134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.584322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.584605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.584880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.585154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.585512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.586035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.586330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.597557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.600610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.604183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.604297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.605611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.607121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.607358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.607445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.607689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.610303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.611725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.613234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.613466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.613759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.614220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.615693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.619473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.619767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.620055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.620339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.621313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.622637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.625630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.625941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.626227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.626508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.628403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.628698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.628979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.634937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.635228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.635505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.636187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.636470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.636752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.637031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.637324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.637598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.638023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.638246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.638420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.638690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.638985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.639256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.639520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.639779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.642403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:16:55.642683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.642959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.643231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.643508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.643779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.644050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.644314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.644588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.644857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.645147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.645414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.645685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.645969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:16:55.674595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55702b3e29c0 pid: 81584 (default app) Aug 24 09:16:55.678029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed775-c28d-44a9-bd4a-a494f6e542bd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:16:55.678320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed775-c28d-44a9-bd4a-a494f6e542bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:16:55.678597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ed775-c28d-44a9-bd4a-a494f6e542bd None None] PATH_INFO: `/v3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:16:55.681929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55702b3e29c0 pid: 81583 (default app) Aug 24 09:16:55.683530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Aug 24 09:16:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:03.297406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:03.297952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:03.297952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:03.302179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:03.309676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:03.310158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:03.310266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:03.380379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: INFO dbcounter [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] Registered counter for database keystone Aug 24 09:17:03.399641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG oslo_db.sqlalchemy.engines [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:17:03.405887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writer thread running {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:17:03.586323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81584) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:17:03.586662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81584) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:17:03.641950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:03.643547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:03.773342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 09:17:04.245163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:04.316227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: INFO dbcounter [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] Registered counter for database keystone Aug 24 09:17:04.338775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:17:04.345183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writer thread running {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:17:04.466319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9e747-e190-4891-9cb8-83815c75dcb1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:04.470544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:04.471170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:04.471449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:04.471717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:04.480044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:04.533640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:17:04.533937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908245c-c1eb-45c3-89e1-6d5de0d3f8d7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:04.543725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Aug 24 09:17:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:17:04.549700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:04.564289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680e036-ddec-476d-bdaa-c2d67e48b3ce None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:04.568845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:04.570547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:04.570836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:04.571115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] PATH_INFO: `/v3/projects/808b3dabc5b4438aaacc878cdfe73e11` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:04.572675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] RBAC: Authorizing `identity:get_project(project_id=808b3dabc5b4438aaacc878cdfe73e11)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:04.625100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING keystone.common.rbac_enforcer.enforcer [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:17:04.625444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c50a36-e0da-4a3a-8515-0471b73a7025 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:04.629983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Aug 24 09:17:04 2022] GET /identity/v3/projects/808b3dabc5b4438aaacc878cdfe73e11 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:06.517365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e22bcc-d454-4ceb-a3ac-4ca142b70b90 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:06.517974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e22bcc-d454-4ceb-a3ac-4ca142b70b90 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:06.517974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e22bcc-d454-4ceb-a3ac-4ca142b70b90 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:06.522290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:06.527887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:06.528280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:06.528446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:06.547847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:06.549395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:06.557731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 09:17:06.830810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e22bcc-d454-4ceb-a3ac-4ca142b70b90 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:06.843162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e22bcc-d454-4ceb-a3ac-4ca142b70b90 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:06.847256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e734-440e-414c-a592-00dc3808b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:06.847850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e734-440e-414c-a592-00dc3808b0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:06.848132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e734-440e-414c-a592-00dc3808b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:06.848403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e734-440e-414c-a592-00dc3808b0a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:06.856442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e734-440e-414c-a592-00dc3808b0a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:06.858245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e734-440e-414c-a592-00dc3808b0a4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:06.867668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Aug 24 09:17:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:17:06.873095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:06.882192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a4c6-bad2-4be3-9a01-be4aae25a74d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:06.886550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa305641-cc6f-495b-a45e-0df7868ad246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:06.887179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa305641-cc6f-495b-a45e-0df7868ad246 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:06.887462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa305641-cc6f-495b-a45e-0df7868ad246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:06.887737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa305641-cc6f-495b-a45e-0df7868ad246 admin admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:06.889030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa305641-cc6f-495b-a45e-0df7868ad246 admin admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:06.890879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa305641-cc6f-495b-a45e-0df7868ad246 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:06.892382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Aug 24 09:17:06 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:08.851308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7fd32-8b7c-4d6f-8ba2-0a86a26ddff4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:08.851830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7fd32-8b7c-4d6f-8ba2-0a86a26ddff4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:08.852013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7fd32-8b7c-4d6f-8ba2-0a86a26ddff4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:08.853311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:08.858608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:08.859050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:08.859322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:08.878110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:08.879306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:08.890959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820024f-053c-4018-917b-a81f914fb781 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:08.891262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820024f-053c-4018-917b-a81f914fb781 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:08.891544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820024f-053c-4018-917b-a81f914fb781 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:08.892862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:08.897967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:08.898263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:08.898544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:08.940941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG passlib.handlers.bcrypt [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81583) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:17:08.941357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG passlib.handlers.bcrypt [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81583) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:17:08.963033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:08.986919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:08.988527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:09.086534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:09.228034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.252225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.331754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c907de-439b-4dd1-b453-1f14d7c9186c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.362632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.364791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.365430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.365717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.366058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.377776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:09.386344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:09.387315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:09.388153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:09.393078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.466506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dd542-8ae6-4d91-8d52-ce4ff0bb0795 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.468938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.474877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.493002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841014-a2a1-44e2-96b4-47654e5e8721 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.503189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.504056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.504344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.504656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.529517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.530165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.530454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.530792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.531490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:09.531798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.533222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:09.545705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:09.551604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.572779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.574326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:09.652747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5b70-95f3-4c22-a5f0-17b462444b5b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.672804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:17:09.678343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.681224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.687177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.687807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.688091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.688370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.689544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.691023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:09.692806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:09.698859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.715491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.775856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7590-bcef-4614-bfac-b6b1d914bf8b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.800488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6540b-907f-4fe3-853c-de91b09f4aba None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.809667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.810557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.810850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.811133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.831817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.833303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:09.839834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.840470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.840750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.841025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.842323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.843797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:09.845344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:09.851191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:17:09.852889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:09.854667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:17:09.855539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:17:09.855539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:17:09.855539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:09.855539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:09.859630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:09.918501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.934594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:09.957226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53416aea-14d7-4220-956b-7c7dd5de4e34 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.962184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e762e8-694d-48fb-96df-6e65b0e84fbc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:09.992340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.992946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.993233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.993515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.994277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.domain.id=default, user.id=07fe569d9cd046878133757fe1ce9618) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:09.994594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.996033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b4447-cf94-410a-aba2-14a5f02ce0f8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:09.996248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:09.996854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:09.997172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:09.997476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:09.998198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:09.998505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:09.999876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359922-e95b-41bc-afba-3039ae223aec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:10.002980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/role_assignments?user.id=07fe569d9cd046878133757fe1ce9618&scope.domain.id=default&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:10.033889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:12.164670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616ec9-bc6f-4ac8-9565-6ac6c3145fd0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.165148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616ec9-bc6f-4ac8-9565-6ac6c3145fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.165148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4616ec9-bc6f-4ac8-9565-6ac6c3145fd0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:12.166493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:12.177103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2603-0cc6-4c61-80e4-e024d881f704 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.177574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2603-0cc6-4c61-80e4-e024d881f704 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.177646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda2603-0cc6-4c61-80e4-e024d881f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:12.207448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-eeda2603-0cc6-4c61-80e4-e024d881f704 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:12.208657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eeda2603-0cc6-4c61-80e4-e024d881f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:12.304230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:12.408170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ee354-8bc9-4726-8d7b-0ab61d011a07 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.408813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ee354-8bc9-4726-8d7b-0ab61d011a07 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.409302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ee354-8bc9-4726-8d7b-0ab61d011a07 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:12.410943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:12.417624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15191-0d94-4112-b23d-3f16ba8dfdff None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.417847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15191-0d94-4112-b23d-3f16ba8dfdff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.418311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff15191-0d94-4112-b23d-3f16ba8dfdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:12.446864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-eff15191-0d94-4112-b23d-3f16ba8dfdff None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:12.448290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eff15191-0d94-4112-b23d-3f16ba8dfdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:12.511127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:12.543239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:12.618371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65d914-e15f-4a8a-bb8a-ececae604b3e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.618992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65d914-e15f-4a8a-bb8a-ececae604b3e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.619485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65d914-e15f-4a8a-bb8a-ececae604b3e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:12.621009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 14/26] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:12.635870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.636456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.636870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:12.664742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:12.666207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:12.738709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65d914-e15f-4a8a-bb8a-ececae604b3e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:12.772831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 13/27] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:12.890018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65d914-e15f-4a8a-bb8a-ececae604b3e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:12.914002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:12.979105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:12.979751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:12.980034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:12.980379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.010809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:13.012240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:13.018237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:17:13.044293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:13.045199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:17:13.046043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:17:13.046043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:17:13.046043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:13.050289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 15/28] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:13.057341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:13.153712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a948a-bc15-44d1-865b-c42a2bab4747 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:13.164033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:13.219194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da597c-d847-4a2a-b181-4b7b81e0fe3d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:13.229365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:13.230110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.230361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.230848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.244284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:13.253304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:13.254194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:13.254935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:13.255899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:13.256739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.257184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.257468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 14/29] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:13.258006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.258793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:13.259083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:13.259182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:13.260509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9e534-1a15-4f76-9450-18a978e77fde None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:13.282363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 16/30] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:13.283659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856d036-7edf-47b6-9875-d7e42f3f41f6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.283978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856d036-7edf-47b6-9875-d7e42f3f41f6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.284331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856d036-7edf-47b6-9875-d7e42f3f41f6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.286158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 17/31] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:13.287173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856d036-7edf-47b6-9875-d7e42f3f41f6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:13.353110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:13.389182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3551-1200-400e-9c55-5811ad4f9e30 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:13.404865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856d036-7edf-47b6-9875-d7e42f3f41f6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:13.433244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:13.434031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.435183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.435467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.436153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:13.437767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:13.450945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:13.451839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.452281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.452716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.454048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:13.454048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:13.455586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ceb572-2925-4593-ac59-0fa38c10a49d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:13.465523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 18/32] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:13.467160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.467604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.468081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.488333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:13.489613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:13.565131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 19/33] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:13.566165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:13.630671 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:13.649887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 15/34] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 24 09:17:13 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:13.649887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:13.700515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:13.735916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b235-0d20-4c40-9284-f74fab440774 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:13.811014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:13.812098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.812605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.813086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.813979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec855-ea2d-4c99-9498-d6f4053668f5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:13.814270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:13.816246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:13.856418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5193-6b9d-4dc1-9721-f0471066cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:13.857076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5193-6b9d-4dc1-9721-f0471066cc37 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.857366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5193-6b9d-4dc1-9721-f0471066cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.857646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5193-6b9d-4dc1-9721-f0471066cc37 None admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.859334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5193-6b9d-4dc1-9721-f0471066cc37 None admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:13.861714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e5193-6b9d-4dc1-9721-f0471066cc37 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:13.863619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 16/35] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:13 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:13.867569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240474cb-a8fc-47ba-8b67-6bc288bbcea1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:13.867569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240474cb-a8fc-47ba-8b67-6bc288bbcea1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:13.867569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240474cb-a8fc-47ba-8b67-6bc288bbcea1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:13.873105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 17/36] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:13.873105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240474cb-a8fc-47ba-8b67-6bc288bbcea1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:13.984285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:13.992777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240474cb-a8fc-47ba-8b67-6bc288bbcea1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:14.028782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c6f62-5b4a-487e-997d-7c255609d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:14.029521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6f62-5b4a-487e-997d-7c255609d5cb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.029813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6f62-5b4a-487e-997d-7c255609d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.030219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6f62-5b4a-487e-997d-7c255609d5cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.031442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c6f62-5b4a-487e-997d-7c255609d5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:14.032896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c6f62-5b4a-487e-997d-7c255609d5cb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:14.039413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 18/37] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:14.039413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.039413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.039413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.056572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:14.058365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:14.145969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 19/38] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:14.145969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:14.157632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:17:13 2022] POST /identity/v3/projects => generated 301 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:14.158758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:14.269252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:14.280664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc61c9-f874-40f6-bc23-0828c9e0f8a6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:14.296035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:14.301387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458baa1e-e42e-42ab-8789-e6403708845e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:14.325580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e6fe-09c4-47ef-abd5-5a7f84d95be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:14.326237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e6fe-09c4-47ef-abd5-5a7f84d95be3 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.326528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e6fe-09c4-47ef-abd5-5a7f84d95be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.326807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e6fe-09c4-47ef-abd5-5a7f84d95be3 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.327567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2e6fe-09c4-47ef-abd5-5a7f84d95be3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:14.328943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2e6fe-09c4-47ef-abd5-5a7f84d95be3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:14.343240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:14.343910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.344193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.344478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] PATH_INFO: `/v3/domains/default/users/07fe569d9cd046878133757fe1ce9618/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.347324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=07fe569d9cd046878133757fe1ce9618, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:14.348982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:14.408203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 20/40] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 24 09:17:14 2022] POST /identity/v3/roles => generated 225 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:14.408203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae0608-3b74-4f8d-9b4a-391eaef74331 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.408203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae0608-3b74-4f8d-9b4a-391eaef74331 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.408203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae0608-3b74-4f8d-9b4a-391eaef74331 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.408203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 21/41] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:14.414981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.415297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.415665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.430209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 21/42] 10.222.0.60 () {58 vars in 1361 bytes} [Wed Aug 24 09:17:14 2022] PUT /identity/v3/domains/default/users/07fe569d9cd046878133757fe1ce9618/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:14.431376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:14.439520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:14.440788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:14.532162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:14.579243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c21f5e-c6e0-4109-a32d-643c0ffd9721 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:14.618291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:14.618912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.619200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.619481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.620159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:14.621564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:14.698397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 24 09:17:14 2022] POST /identity/v3/roles => generated 223 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:14.806830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:14.900268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:14.919417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dd6e8-934d-4d4b-bc63-06059fe9cabd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:14.953055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122de15-6336-4741-993b-da612d7cdd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:14.953605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122de15-6336-4741-993b-da612d7cdd94 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:14.953910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122de15-6336-4741-993b-da612d7cdd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:14.954187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122de15-6336-4741-993b-da612d7cdd94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:14.955426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122de15-6336-4741-993b-da612d7cdd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:14.957286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122de15-6336-4741-993b-da612d7cdd94 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:14.959168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 23/45] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:14.965653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:14.988505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:15.070246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f96d-4b91-487c-a8dd-0afc707989cb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:15.107120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8269a-3fa4-4eee-abdc-a760f9afc93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:15.107937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8269a-3fa4-4eee-abdc-a760f9afc93f None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:15.108222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8269a-3fa4-4eee-abdc-a760f9afc93f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:15.108503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8269a-3fa4-4eee-abdc-a760f9afc93f None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:15.109141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8269a-3fa4-4eee-abdc-a760f9afc93f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:15.110738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8269a-3fa4-4eee-abdc-a760f9afc93f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:15.215713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:17:14 2022] POST /identity/v3/projects => generated 312 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:16.393221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664da20-7af8-47c0-b959-517353962a8b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:16.393739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664da20-7af8-47c0-b959-517353962a8b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:16.393821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664da20-7af8-47c0-b959-517353962a8b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:16.395136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:16.401188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:16.401619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:16.401754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:16.422492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:16.424090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:16.493219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:16.770149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664da20-7af8-47c0-b959-517353962a8b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:16.877958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664da20-7af8-47c0-b959-517353962a8b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.016996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.017624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.017935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.018217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.028791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:17.033787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:17.034710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:17.035454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:17.040912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:17.043127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:17.140289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208b779-781b-4b28-b570-9ada7f8b778f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.176676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.177288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.177570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.177844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.179138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:17.179443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:17.180812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57adce8-6395-4880-9f34-0258bcede3e1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:17.188939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:17.194552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:17.207224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:17.265835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d22ba-b68f-4b41-92f2-6cdab8de2d89 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.266147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d22ba-b68f-4b41-92f2-6cdab8de2d89 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.266426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d22ba-b68f-4b41-92f2-6cdab8de2d89 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.267772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 26/51] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:17.272872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.273166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.273452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.291620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:17.292740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:17.293877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f77d-4258-451e-8551-59c6504a7000 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.327255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.327875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.328165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.328436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.329560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:17.331038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:17.332847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 26/52] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:17 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:17.338748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:17.353180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:17.361373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 27/53] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:17.416809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:17.438598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646f52-5c7c-4761-a0f1-e912de692f3d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.476441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.477069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.477355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.477631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.481749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:17.483313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:17.484885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:17.491570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:17.588636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e194-292f-4346-8c34-29e303c6bb9b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.621162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.621767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.622079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.622354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.623081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.domain.id=default, user.id=07fe569d9cd046878133757fe1ce9618) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:17.623390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:17.624816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:17.629595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:17.630483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Aug 24 09:17:17 2022] GET /identity/v3/role_assignments?user.id=07fe569d9cd046878133757fe1ce9618&scope.domain.id=default&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:17.737731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94853f4d-0a0f-496c-b75c-df674ef9bff8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.773424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb58d9-8d91-4ae3-9286-df73f6cd7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.775042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb58d9-8d91-4ae3-9286-df73f6cd7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.775042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb58d9-8d91-4ae3-9286-df73f6cd7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.775042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb58d9-8d91-4ae3-9286-df73f6cd7bb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.776554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb58d9-8d91-4ae3-9286-df73f6cd7bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:17.778031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb58d9-8d91-4ae3-9286-df73f6cd7bb5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:17.779771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:17.785319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:17.851566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:17.892217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112259df-c20f-4cf2-9511-9062a940f8db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:17.924940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc009282-5178-4a03-b06b-c0ca121d848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:17.925543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc009282-5178-4a03-b06b-c0ca121d848d None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:17.925826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc009282-5178-4a03-b06b-c0ca121d848d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:17.926133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc009282-5178-4a03-b06b-c0ca121d848d None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:17.926772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc009282-5178-4a03-b06b-c0ca121d848d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:17.928776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc009282-5178-4a03-b06b-c0ca121d848d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:18.021789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Aug 24 09:17:17 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:19.921911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063b767-a01b-422e-8169-9883ebc639dc None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:19.922418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063b767-a01b-422e-8169-9883ebc639dc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:19.922503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063b767-a01b-422e-8169-9883ebc639dc None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:19.923908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:19.929475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:19.929892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:19.930070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:19.948800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:19.950049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:20.015513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:20.284190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063b767-a01b-422e-8169-9883ebc639dc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:20.300141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:20.383970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063b767-a01b-422e-8169-9883ebc639dc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:20.416546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb573d-8cc6-478f-a591-ea23ff795201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:20.417170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb573d-8cc6-478f-a591-ea23ff795201 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:20.417453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb573d-8cc6-478f-a591-ea23ff795201 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:20.417730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb573d-8cc6-478f-a591-ea23ff795201 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:20.418868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb573d-8cc6-478f-a591-ea23ff795201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:20.420298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb573d-8cc6-478f-a591-ea23ff795201 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:20.421836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:20.427462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:20.469226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:20.525103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f78856-5456-48ee-ad97-530c7f1c051a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:20.559900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cecb20-5b40-4f5a-85d4-8faa14af43af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:20.560446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cecb20-5b40-4f5a-85d4-8faa14af43af None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:20.560727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cecb20-5b40-4f5a-85d4-8faa14af43af None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:20.561004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cecb20-5b40-4f5a-85d4-8faa14af43af None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:20.561651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cecb20-5b40-4f5a-85d4-8faa14af43af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:20.563119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cecb20-5b40-4f5a-85d4-8faa14af43af None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:20.652591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:20 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:23.653521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eef7d5-5785-48db-a115-2136e916f0d6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:23.654063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eef7d5-5785-48db-a115-2136e916f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:23.654171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eef7d5-5785-48db-a115-2136e916f0d6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:23.655445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:23.671579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339f5a-46b5-4aa7-8197-bf52a44dcf2d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:23.672535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339f5a-46b5-4aa7-8197-bf52a44dcf2d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:23.673013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339f5a-46b5-4aa7-8197-bf52a44dcf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:23.702854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b6339f5a-46b5-4aa7-8197-bf52a44dcf2d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:23.704384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6339f5a-46b5-4aa7-8197-bf52a44dcf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:23.795531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 32/63] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:23.894646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9136d-fb7e-4320-b0c7-9210050d4d25 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:23.895279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9136d-fb7e-4320-b0c7-9210050d4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:23.895871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9136d-fb7e-4320-b0c7-9210050d4d25 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:23.898098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 32/64] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:23.903766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fee23-441f-45d9-8179-aac679b7728a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:23.903991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fee23-441f-45d9-8179-aac679b7728a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:23.904271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fee23-441f-45d9-8179-aac679b7728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:23.930866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-353fee23-441f-45d9-8179-aac679b7728a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:23.932111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-353fee23-441f-45d9-8179-aac679b7728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:23.955655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.014725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 33/65] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:24.020972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4e11-471a-4768-a198-f4c6f73cebc1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.021511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4e11-471a-4768-a198-f4c6f73cebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.022732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e4e11-471a-4768-a198-f4c6f73cebc1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.024299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:24.029650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.029967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.030248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.059023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:24.060211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:24.066672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33da5-3027-4942-b69f-73b0b84f15ca None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.067208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33da5-3027-4942-b69f-73b0b84f15ca None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.067716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb33da5-3027-4942-b69f-73b0b84f15ca None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.070049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 34/67] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:24.075298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799262-9ffe-4488-8251-51d08d25555e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.075810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799262-9ffe-4488-8251-51d08d25555e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.076287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44799262-9ffe-4488-8251-51d08d25555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.120180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-44799262-9ffe-4488-8251-51d08d25555e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:24.121380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-44799262-9ffe-4488-8251-51d08d25555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:24.179805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 34/68] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:24.216166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 35/69] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:24.276933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.291933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44799262-9ffe-4488-8251-51d08d25555e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.316831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.447970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.465765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dc034-2993-4dc5-a1e9-4e2a86b1b6c6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.468714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44799262-9ffe-4488-8251-51d08d25555e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.503098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.503734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.504021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.504180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d564-57d8-45ef-9b10-aad27d382ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.504285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.504767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d564-57d8-45ef-9b10-aad27d382ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.505043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d564-57d8-45ef-9b10-aad27d382ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.505319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d564-57d8-45ef-9b10-aad27d382ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.515891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54d564-57d8-45ef-9b10-aad27d382ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:24.516789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1f54d564-57d8-45ef-9b10-aad27d382ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:24.520592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:24.522198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:24.523210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:24.523988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:24.525701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:24.528273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:24.529907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e51a6-eb20-4db6-be37-0cf9be6a1c54 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.529907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e51a6-eb20-4db6-be37-0cf9be6a1c54 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.530200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:24.530340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e51a6-eb20-4db6-be37-0cf9be6a1c54 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.530793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.530953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 37/72] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:24.530953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e51a6-eb20-4db6-be37-0cf9be6a1c54 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.599557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.629709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e51a6-eb20-4db6-be37-0cf9be6a1c54 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.634149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db933218-d6e5-44b5-a92b-3b6b5e2b331f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.663977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5276b-f1e1-4f63-8f08-3f7ed58d93ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.664609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5276b-f1e1-4f63-8f08-3f7ed58d93ba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.664899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5276b-f1e1-4f63-8f08-3f7ed58d93ba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.665179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5276b-f1e1-4f63-8f08-3f7ed58d93ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.668248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.668877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.669167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.669452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.675374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5276b-f1e1-4f63-8f08-3f7ed58d93ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:24.679390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-bef5276b-f1e1-4f63-8f08-3f7ed58d93ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:24.680662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:24.681529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:24.682317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 38/73] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:24.684089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:24.684931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:24.685681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:24.686850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.686850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.687045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 36/74] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:24.687113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.687176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.695671 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.706434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:24.706434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:24.771282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 39/75] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:24.774790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.786097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9a8b7-ecbd-4c15-8d94-8b2d0734a174 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.823996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.824535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.824818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.825092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.825761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:24.826094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:24.827493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:24.837789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 37/76] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:24.839924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.848710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.888683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222821a0-29c1-4f12-a073-5ccbe4b42dae None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.913424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:24.924942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.925561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.925846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.926161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.926831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:24.927135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:24.928533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:24.940318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 40/77] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:24.946502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:24.950856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ed79-945a-47c2-b5a5-9b732e7c08af None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:24.987962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:24.988912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:24.989365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:24.989808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:24.990900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:24.991459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:24.993167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.002139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 38/78] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.003262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.050692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ef6dc-ce26-4885-ade7-613e5cb73831 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.075892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.086642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.087255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.087536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.087841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.089528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:25.089528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.090200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.098256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 41/79] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:17:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.103014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.108956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fdd01-987a-41c2-af34-f4b54aa744cf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.137756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.143531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.144162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.144443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.144718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.145835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.147783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.149349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 39/80] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.150823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.203267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f44ff-aec2-47ed-b848-8a4f56b87f14 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.237125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.237756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.238133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.238355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.252431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931666e-931c-40c8-a19a-6adcc3d6a1de None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.253123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.254613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.256249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 42/81] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.257140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.289238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.289890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.290177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.290457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.291584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.293034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.294629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 40/82] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.295395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.303966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.360364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.360691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8206842-7c5e-4e40-a920-79fa02d67fcf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.394300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.394934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.395224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.395502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.396700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.397692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509440-30ec-45b0-acb2-6573f93fab5a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.398217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.399946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 43/83] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.400545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.432533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.433190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.433481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.433762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.434932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.436411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.437976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 41/84] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:25.438747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.502254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea04aa0-a93c-4340-96af-ab3f7227aedb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.514635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.535355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.535967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.536254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.536590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8fc84-751a-4d49-9b9a-ec06c04eea94 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.536695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.570773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.571378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.571661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.571940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.574516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.604696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.606213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.639618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.641069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.704409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 44/85] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:25.705269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.719466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.738472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 42/86] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:25.739297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:25.774116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.802857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeaa71-7f85-42e8-bcd7-8b687c8b84fa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.839320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.839932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.840211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.840482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.844448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b46ef8-4147-4943-abe2-55ee054c5c31 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:25.879215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:25.879949 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:25.880236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:25.880515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:25.881688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.883173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.907331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:25.910388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:25.922296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:25.963981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 43/87] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:25 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:25.964893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.023102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 45/88] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:26.023981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.075546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:26.086732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825e3e2-e6c2-4841-8e6d-f16dad09bb83 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.129461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.130131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.130420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.130696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.138453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840f5c-3ad8-43e4-b63d-8bcb2b2769b7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.152307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:26.183857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.184674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.184956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.186387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.187691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.189208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.191076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 46/89] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.191678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.217132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.219539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.315667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f95d33-f590-4840-a71c-e27d90d1ac08 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.339137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:26.353823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 44/90] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:26.359414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.367531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.368486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.368990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.369460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.370857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.372629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.374791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 47/91] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.375749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.431272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:26.474202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a7f00-14af-4d1f-bf5c-0a900a3a4e49 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.486561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf5f73-f248-434d-833e-265699fb5ce8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.511327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.511937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.512225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.512503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] PATH_INFO: `/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.513717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] RBAC: Authorizing `identity:get_project(project_id=19b4e9edc5134c3a8b9263fb0bd53076)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.515279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.517039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 45/92] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.517634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.527330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.528268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.528764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.529229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.530230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=07fe569d9cd046878133757fe1ce9618) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:26.530732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.532355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.542118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 48/93] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/role_assignments?user.id=07fe569d9cd046878133757fe1ce9618&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.543337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.589809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:26.635758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cb1b8-df4c-4918-8075-38b09d88aef2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.656239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dc88f-1fb3-4e2b-a37f-5382138d9713 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.674342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.674956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.675183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.675467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.676695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.678248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.680149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 46/94] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.680779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.683939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:26.705478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.706396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.706677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.706956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.707775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=8f6560bddfbf45d5a00b083ee16509c1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:26.708089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.711741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.719416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 49/95] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/role_assignments?user.id=8f6560bddfbf45d5a00b083ee16509c1&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.720312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:26.854444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91d8b-8c83-47b5-9fd4-2adb66be09ed None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:26.937566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:26.937566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:26.937566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:26.937566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:26.938343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] RBAC: Adding query filter params (role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=8f6560bddfbf45d5a00b083ee16509c1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:26.938658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:26.941431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168cba4-0649-4ae8-b8b4-4a146601a48d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:26.947406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 50/96] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/role_assignments?user.id=8f6560bddfbf45d5a00b083ee16509c1&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=402534b8089045d3acf4ac1379844e80 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:26.992745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b65b16-8e55-402f-b3c7-303906936efa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:27.034666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:27.046786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:27.047854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:27.048355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:27.048824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:27.049813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=19b4e9edc5134c3a8b9263fb0bd53076, user.id=8f6560bddfbf45d5a00b083ee16509c1) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:27.050358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:27.052069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab5523-bc5d-43d8-87df-f355d0aa75a8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:27.061088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 47/97] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:26 2022] GET /identity/v3/role_assignments?user.id=8f6560bddfbf45d5a00b083ee16509c1&scope.project.id=19b4e9edc5134c3a8b9263fb0bd53076&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 259 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:28.343962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a2c36-3e52-4feb-96ca-8a577d765fe9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:28.344480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a2c36-3e52-4feb-96ca-8a577d765fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:28.344554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a2c36-3e52-4feb-96ca-8a577d765fe9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:28.345874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 51/98] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:28.352106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3843-f02c-4bdb-9830-d6e84cb62702 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:28.352929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3843-f02c-4bdb-9830-d6e84cb62702 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:28.353411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3843-f02c-4bdb-9830-d6e84cb62702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:28.382829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f3ae3843-f02c-4bdb-9830-d6e84cb62702 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:28.384336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f3ae3843-f02c-4bdb-9830-d6e84cb62702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:28.467723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 48/99] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:28.742936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1782-5179-4d20-b161-aede62eade8c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:28.743304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1782-5179-4d20-b161-aede62eade8c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:28.743506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1782-5179-4d20-b161-aede62eade8c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:28.745069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 52/100] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:28.750526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf92596-8566-422d-8ea9-11e9fda6c438 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:28.751040 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf92596-8566-422d-8ea9-11e9fda6c438 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:28.751532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf92596-8566-422d-8ea9-11e9fda6c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:28.778095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ecf92596-8566-422d-8ea9-11e9fda6c438 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:28.779601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ecf92596-8566-422d-8ea9-11e9fda6c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:28.871189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 49/101] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:29.007521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1782-5179-4d20-b161-aede62eade8c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:29.053235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:29.112842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be40944-a2e8-4b13-afa0-a8e3244b27ab None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.113163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be40944-a2e8-4b13-afa0-a8e3244b27ab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.113399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be40944-a2e8-4b13-afa0-a8e3244b27ab None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.114904 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 50/102] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:29.119743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1782-5179-4d20-b161-aede62eade8c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:29.120467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.120760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.121037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.163941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:29.165147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:29.179488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:29.180143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.180435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.180718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.211065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:29.216619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:29.217559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:29.218422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:29.222241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 53/103] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:29.224360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:29.272831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:29.331732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 51/104] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:29.375645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:29.412547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01075b-6c0f-4de1-b6e2-dbb9c3e6f84b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:29.420616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:29.451390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:29.452368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.452661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.453083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.453772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:29.454123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:29.456408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:29.467244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 54/105] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:29.473312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:29.590449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf3ad9-002b-4ee2-920d-616312c94eb9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:29.603432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4c35b-3c5c-4045-870e-9bf8db92acbb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:29.629131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:29.629767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.630262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.630546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] PATH_INFO: `/v3/users/4524101cb3eb44edbfbb9aa1a01bcc83` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.658489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] RBAC: Authorizing `identity:get_user(user_id=4524101cb3eb44edbfbb9aa1a01bcc83)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:29.659968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:29.661661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 55/106] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:29 2022] GET /identity/v3/users/4524101cb3eb44edbfbb9aa1a01bcc83 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:29.667997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:29.674161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:29.674819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.676074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.676358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.681963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:29.683441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:29.685231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 52/107] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:29.690755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:29.711645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:29.770848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:29.814676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457a87a-acca-4205-9df5-4dd90cf22a98 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:29.851888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36acc4-6bf2-4368-98ea-fb32662aa118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:29.852426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36acc4-6bf2-4368-98ea-fb32662aa118 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.852713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36acc4-6bf2-4368-98ea-fb32662aa118 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.852988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36acc4-6bf2-4368-98ea-fb32662aa118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.863742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1adb75-0223-45e2-9b60-1f3f828ea47c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:29.915296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:29.916169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:29.916882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:29.917171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:29.918134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:29.920270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:29.926688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36acc4-6bf2-4368-98ea-fb32662aa118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:29.929001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36acc4-6bf2-4368-98ea-fb32662aa118 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:29.951740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.013768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 53/108] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:17:29 2022] POST /identity/v3/projects => generated 302 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:17:30.014814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.040857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 56/109] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:30.047034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e55dd-acc4-43e3-9cf6-15285bbeebaf None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.047442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e55dd-acc4-43e3-9cf6-15285bbeebaf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.047853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e55dd-acc4-43e3-9cf6-15285bbeebaf None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.049519 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 57/110] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:30.050845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640c98a-93ed-46b5-8a6a-3f073ca89aa1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.051254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640c98a-93ed-46b5-8a6a-3f073ca89aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.051662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640c98a-93ed-46b5-8a6a-3f073ca89aa1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.053649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 58/111] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:30.054538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640c98a-93ed-46b5-8a6a-3f073ca89aa1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.144884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.148194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a3dc2-edd9-43ff-ba91-81151308c9c0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.174745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640c98a-93ed-46b5-8a6a-3f073ca89aa1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.189645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1e09e-790f-4dcc-92f2-ad586f3aa8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.190587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e09e-790f-4dcc-92f2-ad586f3aa8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.191050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e09e-790f-4dcc-92f2-ad586f3aa8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.191333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1e09e-790f-4dcc-92f2-ad586f3aa8b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.200236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.204623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1e09e-790f-4dcc-92f2-ad586f3aa8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6fc1e09e-790f-4dcc-92f2-ad586f3aa8b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:30.211038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:30.211919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 54/112] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:30.214680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.215366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.215366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.228430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3cb9-f6a0-4059-997f-254d5caa4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.233923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3cb9-f6a0-4059-997f-254d5caa4105 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.233923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3cb9-f6a0-4059-997f-254d5caa4105 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.233923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3cb9-f6a0-4059-997f-254d5caa4105 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.233923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3cb9-f6a0-4059-997f-254d5caa4105 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:30.234178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:30.234263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3cb9-f6a0-4059-997f-254d5caa4105 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:30.234684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:30.235467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 59/113] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:30.236392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.236679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.236953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.261903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:30.263140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:30.306906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 55/114] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:30.307777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.343018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 60/115] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:30.343694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.413802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.427383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ea0b-aa2d-4ec9-9f29-33cb71230bf1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.447158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293869-d36f-4f6b-82b5-7c7672950e42 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.470192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.471117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.471575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.472363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.473509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:30.474033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:30.476035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23aff-18ed-44fa-be50-668bae73cf09 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:30.485807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 56/116] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:30.487361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad8dd-96e2-474c-ba5c-f75acd04634b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.488008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad8dd-96e2-474c-ba5c-f75acd04634b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.488487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad8dd-96e2-474c-ba5c-f75acd04634b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.490547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 57/117] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:30.491969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.494567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad8dd-96e2-474c-ba5c-f75acd04634b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.527149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.531416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.531940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.532434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.533368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] RBAC: Adding query filter params (role.id=b2b4db89dc10402c80dbb7a173382ec3, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=4524101cb3eb44edbfbb9aa1a01bcc83) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:30.534868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:30.536997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcad0c-0bf4-45a9-9e8d-987c45e807eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:30.553307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 61/118] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/role_assignments?user.id=4524101cb3eb44edbfbb9aa1a01bcc83&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=b2b4db89dc10402c80dbb7a173382ec3 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:30.555018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.556579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.557177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.597748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:30.601570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:30.681046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad8dd-96e2-474c-ba5c-f75acd04634b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.721302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 62/119] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:30.722711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.742073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.743046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.743339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.743665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.745624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:30.749205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:30.752188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 58/120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:30.752710 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.778302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.848726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed8f34-6da5-491f-b58f-18084f089689 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.863515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:30.874859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9088-1624-4d91-bae5-611ee9916957 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:30.886492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.887176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.887462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.887740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.902487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:30.909035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:30.909920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:30.910693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 63/121] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:30.911306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:30.915531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:30.916449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:30.916974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:30.917461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:30.929794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:30.935121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:30.935952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:30.936716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:30.939327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 59/122] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:30.940320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.039033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:31.044040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394b71d-5db0-41aa-b397-5918d5fcb69a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.061988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c760e9-a2c5-4938-83ae-0965ea9ac348 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.103105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.104266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.104751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.105697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.106586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:31.107088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.108662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.119379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 60/123] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:31.120487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.144184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.144838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.145146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.145727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.149159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.150692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.152441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 64/124] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:30 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:31.153219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.213164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:31.245901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7dc6-0fbc-4ae6-866c-4572a4d8fff5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.275536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd297e-4e07-4463-a791-5e4548393679 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.290673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.291853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.292504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.292891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.293677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:31.294136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.296020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.307292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 61/125] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:31.307292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.313804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:31.317654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.318572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.319050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.319523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.320931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.322616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.324366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 65/126] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:31.325315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.431692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d334a-b95f-44cb-9a56-996065257b9e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.441148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:31.448600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388602a-844c-4dce-b30f-b368f12af885 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.475881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.476533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.477129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.477528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.487188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.488106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.488538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.488972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/07fe569d9cd046878133757fe1ce9618/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.490865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:31.491373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=451e90a11827408c85a7bb4e2f02090f, user_id=07fe569d9cd046878133757fe1ce9618, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.492975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:31.497236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:31.498138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:31.498938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 66/127] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:31.504216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.565339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 62/128] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:31 2022] PUT /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/07fe569d9cd046878133757fe1ce9618/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:31.567230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.667384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:31.676014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865fa45-9dfd-4f73-b12e-4f5d5827f4fa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.719681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb934-0f16-489a-b38e-5091dcce01d7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.763824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.765693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.766259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.766735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.768203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.769942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.770821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.773066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 67/129] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:31.773875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.774842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.775124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.775393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] PATH_INFO: `/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.782524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] RBAC: Authorizing `identity:get_project(project_id=19b4e9edc5134c3a8b9263fb0bd53076)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.784048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.789890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 63/130] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:31.789890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:31.829101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:31.954648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4407-2d84-4381-a14d-27b1b1c7e8ca None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:31.992425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:31.993068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:31.993357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:31.993632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:31.994832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:31.996335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:31.998198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:32.002026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 64/131] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:32.002907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:32.022879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57fbe-2b6c-4606-976b-341a5ec7961f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:32.098548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:32.099703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.100372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.100846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.101712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:32.102231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:32.103805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:32.107399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f535b1-a754-4215-8061-26de4300c64d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:32.122152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 68/132] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:17:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:32.122152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:32.143848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:32.144512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.144800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.145081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] PATH_INFO: `/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076/users/8f6560bddfbf45d5a00b083ee16509c1/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.147245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] RBAC: Authorizing `identity:create_grant(project_id=19b4e9edc5134c3a8b9263fb0bd53076, user_id=8f6560bddfbf45d5a00b083ee16509c1, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:32.148810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:32.251947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 65/133] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:32 2022] PUT /identity/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076/users/8f6560bddfbf45d5a00b083ee16509c1/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:32.254738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:32.258032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:32.266792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f030e-3f4b-4d5c-b99b-98bc1f8a1af1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:32.346763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9f2ec-d312-4324-be4c-948cd80498d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:32.348019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9f2ec-d312-4324-be4c-948cd80498d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.348313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9f2ec-d312-4324-be4c-948cd80498d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.348595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9f2ec-d312-4324-be4c-948cd80498d6 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/8f6560bddfbf45d5a00b083ee16509c1/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.355094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9f2ec-d312-4324-be4c-948cd80498d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=451e90a11827408c85a7bb4e2f02090f, user_id=8f6560bddfbf45d5a00b083ee16509c1, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:32.356592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9f2ec-d312-4324-be4c-948cd80498d6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:32.381735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:32.429782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93362-545d-47a8-8af8-9127426f6733 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:32.452559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 69/134] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:32 2022] PUT /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/8f6560bddfbf45d5a00b083ee16509c1/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:32.453843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ff58-8db8-465c-bcdf-36ff1643301f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.454160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ff58-8db8-465c-bcdf-36ff1643301f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.454441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ff58-8db8-465c-bcdf-36ff1643301f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.456116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 70/135] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:32.462878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.463199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.463487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.486819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:32.487479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.487763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.488044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.489263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:32.491786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:32.493559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 66/136] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:32 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:32.499524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:32.507475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:32.508717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:32.620477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160164-1706-449d-aa6a-7d7f971265cf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:32.651103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:32.653479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 71/137] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:32.659015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343ebe3-cf42-475f-b293-766503d89ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:32.659656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ebe3-cf42-475f-b293-766503d89ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.659945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ebe3-cf42-475f-b293-766503d89ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.660225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ebe3-cf42-475f-b293-766503d89ac4 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.661580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343ebe3-cf42-475f-b293-766503d89ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:32.663871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343ebe3-cf42-475f-b293-766503d89ac4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:32.665647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 67/138] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:32 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:32.671514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:32.775410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:32.789209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b09983-c5c6-4656-8ed2-586bbd980d12 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:32.842642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1c7cd-fe64-44d3-9478-5b79467e223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:32.843648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c7cd-fe64-44d3-9478-5b79467e223c None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.844107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c7cd-fe64-44d3-9478-5b79467e223c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.844585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c7cd-fe64-44d3-9478-5b79467e223c None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/8f6560bddfbf45d5a00b083ee16509c1/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.850199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1c7cd-fe64-44d3-9478-5b79467e223c None admin] RBAC: Authorizing `identity:create_grant(project_id=451e90a11827408c85a7bb4e2f02090f, user_id=8f6560bddfbf45d5a00b083ee16509c1, role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:32.852109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1c7cd-fe64-44d3-9478-5b79467e223c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:32.950540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 72/139] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:32 2022] PUT /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/8f6560bddfbf45d5a00b083ee16509c1/roles/402534b8089045d3acf4ac1379844e80 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:32.964303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42c8fe-53c4-4fdd-855f-518e978ca508 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.964950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42c8fe-53c4-4fdd-855f-518e978ca508 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.965401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42c8fe-53c4-4fdd-855f-518e978ca508 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.966979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 68/140] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:32.978428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870317-79b7-497a-8570-edb426542d37 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:32.978994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870317-79b7-497a-8570-edb426542d37 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:32.979473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870317-79b7-497a-8570-edb426542d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:32.999524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ea870317-79b7-497a-8570-edb426542d37 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:33.001045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea870317-79b7-497a-8570-edb426542d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:33.028789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42c8fe-53c4-4fdd-855f-518e978ca508 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:33.095429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 73/141] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:33.184719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42c8fe-53c4-4fdd-855f-518e978ca508 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:33.240210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:33.240853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:33.241142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:33.241423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:33.242577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:33.244034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:33.245627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 69/142] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:33.251241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870317-79b7-497a-8570-edb426542d37 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:33.343195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:33.366286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870317-79b7-497a-8570-edb426542d37 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:33.408897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:33.409611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:33.409921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:33.410206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:33.410869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:33.412989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:33.502162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:33.565801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 74/143] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:33 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:33.581649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:33.624059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92028d-6fdb-4270-983d-674eda952d73 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:33.660842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:33.661591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:33.662623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:33.662912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:33.673745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:33.679723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:33.680631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:33.681395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 70/144] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:33.688017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:33.834967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b16fc-eb32-457d-b091-94410df5cdae None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:33.889817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:33.890866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:33.891354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:33.891830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:33.892769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:33.893279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:33.894945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:33.897892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:33.911000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 75/145] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:33.916914 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:34.053320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142f569-f549-426b-8b7d-77770582ffcf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:34.081272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:34.092368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:34.093002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:34.093281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:34.093556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] PATH_INFO: `/v3/users/4524101cb3eb44edbfbb9aa1a01bcc83` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:34.096516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] RBAC: Authorizing `identity:get_user(user_id=4524101cb3eb44edbfbb9aa1a01bcc83)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:34.097991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:34.100060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 71/146] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:33 2022] GET /identity/v3/users/4524101cb3eb44edbfbb9aa1a01bcc83 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:34.105456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:34.237778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bafc-a5c5-4a92-9052-606db4706590 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:34.279451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195dca2-222c-4372-bd5a-1a493bb6b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:34.280325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195dca2-222c-4372-bd5a-1a493bb6b968 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:34.280753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195dca2-222c-4372-bd5a-1a493bb6b968 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:34.281200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195dca2-222c-4372-bd5a-1a493bb6b968 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:34.282505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195dca2-222c-4372-bd5a-1a493bb6b968 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:34.284094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195dca2-222c-4372-bd5a-1a493bb6b968 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:34.285882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 76/147] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:34 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:34.292698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:34.370120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ee4d2-293b-42b8-8d74-92206cd193b6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:34.370724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ee4d2-293b-42b8-8d74-92206cd193b6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:34.371208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ee4d2-293b-42b8-8d74-92206cd193b6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:34.372753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 77/148] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:34.378804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:34.379304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:34.379810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:34.415694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:34.418074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:34.420600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e35ea7-e39d-4586-8882-309d04d8de16 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:34.469714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:34.470435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:34.470716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:34.471055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/4524101cb3eb44edbfbb9aa1a01bcc83/roles/b2b4db89dc10402c80dbb7a173382ec3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:34.481712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] RBAC: Authorizing `identity:create_grant(project_id=451e90a11827408c85a7bb4e2f02090f, user_id=4524101cb3eb44edbfbb9aa1a01bcc83, role_id=b2b4db89dc10402c80dbb7a173382ec3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:34.483317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:34.505452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:34.515197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 78/149] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:34.588955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 72/150] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:34 2022] PUT /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f/users/4524101cb3eb44edbfbb9aa1a01bcc83/roles/b2b4db89dc10402c80dbb7a173382ec3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:34.840994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:34.957173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a8f36-22c1-4c08-a95c-0bdd85f16f57 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:34.996880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:34.997586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:34.997887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:34.998164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.016696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:35.021529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:35.022433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:35.023686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 79/151] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:35.030988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:35.121966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:35.183102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5e38c-60b7-457f-b685-ddbbdb335114 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:35.231150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:35.231781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.232069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.232343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.233016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:35.233322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:35.234732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:35.245413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 73/152] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:35.250892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:35.342309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:35.398095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba6726-ad95-4347-a857-5171c8d5eb5b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:35.447622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34679f-9555-4d8b-9788-c6e5a847bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:35.448266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34679f-9555-4d8b-9788-c6e5a847bfdd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.448553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34679f-9555-4d8b-9788-c6e5a847bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.448828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34679f-9555-4d8b-9788-c6e5a847bfdd None admin] PATH_INFO: `/v3/users/07fe569d9cd046878133757fe1ce9618` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.452000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34679f-9555-4d8b-9788-c6e5a847bfdd None admin] RBAC: Authorizing `identity:get_user(user_id=07fe569d9cd046878133757fe1ce9618)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:35.453581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34679f-9555-4d8b-9788-c6e5a847bfdd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:35.455528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 80/153] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:35 2022] GET /identity/v3/users/07fe569d9cd046878133757fe1ce9618 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:35.462180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:35.598161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b2b8a-8130-4a96-a80f-9dc762daf216 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:35.613433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:35.634845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59d33-87f5-478e-95cd-fdc8872ad2c8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.635122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59d33-87f5-478e-95cd-fdc8872ad2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.635398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e59d33-87f5-478e-95cd-fdc8872ad2c8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.636804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 81/154] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:35.638810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f24e67-07f9-4932-9ae9-0a15e1882fbb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.639089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f24e67-07f9-4932-9ae9-0a15e1882fbb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.639361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f24e67-07f9-4932-9ae9-0a15e1882fbb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.640559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 82/155] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:35.644149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c4e8-c172-4c06-b53b-a2dcb803d8fe None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.644426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c4e8-c172-4c06-b53b-a2dcb803d8fe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.644742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c4e8-c172-4c06-b53b-a2dcb803d8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.648516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:35.649084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.649366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.650072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.682394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5214c4e8-c172-4c06-b53b-a2dcb803d8fe None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:35.683576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5214c4e8-c172-4c06-b53b-a2dcb803d8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:35.811015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:35.812495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:35.833070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 83/156] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:35.833321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:35.833688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:35.834108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:35.868656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:35.870525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:35.949957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:35.981442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 84/157] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:36.037339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 74/158] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:36.043462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:36.206093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae740180-869f-4971-b67c-8886a39aab39 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:36.251967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:36.252623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:36.252904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:36.253182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:36.254384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:36.256587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:36.258267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 85/159] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:36 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:36.264185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:36.291033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:36.401488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95d86b-35a6-4d4c-9c8c-5d36cc4a397d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:36.442575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:36.443500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:36.443892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:36.444216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:36.444952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=07fe569d9cd046878133757fe1ce9618) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:36.445256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:36.446704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:36.458056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 75/160] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:36 2022] GET /identity/v3/role_assignments?user.id=07fe569d9cd046878133757fe1ce9618&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:36.535420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:36.613535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:36.640553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:36.682129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beab36-b59c-4c82-b93a-3ee4f82ffb1f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:36.747238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:36.747806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:36.748091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:36.748365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:36.781640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:36.788008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:36.788910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:36.789780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 86/161] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:36.795981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:36.814338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:36.851561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6b3b-7cd1-4f36-9a47-041f09e1a9a1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:36.928320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328108b-55da-4664-af7b-14478497189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:36.929175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328108b-55da-4664-af7b-14478497189e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:36.929462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328108b-55da-4664-af7b-14478497189e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:36.929736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328108b-55da-4664-af7b-14478497189e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:36.950165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328108b-55da-4664-af7b-14478497189e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8328108b-55da-4664-af7b-14478497189e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:36.955016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:36.956137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:36.956908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 76/162] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:36.964488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328108b-55da-4664-af7b-14478497189e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:37.009697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afba714-2e46-43a5-b8d3-c122d4d69719 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:37.029465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:37.082604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:37.083230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.084076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.084523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.085303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:37.085616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:37.087069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:37.101793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 87/163] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:37.108047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:37.152140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328108b-55da-4664-af7b-14478497189e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:37.230834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:37.231446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.231725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.232062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.232737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:37.233038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:37.234456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e169d-6916-430f-8e10-44bc5a08ccfa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:37.246539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:37.254239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 77/164] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:37.255516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138003-f1b4-489a-a4a0-a65af8a79a2c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.255921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138003-f1b4-489a-a4a0-a65af8a79a2c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.256407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138003-f1b4-489a-a4a0-a65af8a79a2c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.257692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 78/165] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:37.267848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c138003-f1b4-489a-a4a0-a65af8a79a2c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:37.289756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfac5b-9442-41a2-8b14-cc5c61802503 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:37.368034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940f16a-4b9e-450a-9378-8d69051b5df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:37.368673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940f16a-4b9e-450a-9378-8d69051b5df3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.368949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940f16a-4b9e-450a-9378-8d69051b5df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.369222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940f16a-4b9e-450a-9378-8d69051b5df3 None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.370489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940f16a-4b9e-450a-9378-8d69051b5df3 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:37.374447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940f16a-4b9e-450a-9378-8d69051b5df3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:37.376410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 88/166] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:37 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:37.377543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.377820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.378116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.398084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:37.399468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:37.436981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:37.444720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c138003-f1b4-489a-a4a0-a65af8a79a2c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:37.481019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 89/167] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:37.482161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:37.509965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d1cb7-c314-4e04-bff6-38ba9917f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:37.511356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d1cb7-c314-4e04-bff6-38ba9917f051 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.511829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d1cb7-c314-4e04-bff6-38ba9917f051 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.512260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d1cb7-c314-4e04-bff6-38ba9917f051 None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.513961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d1cb7-c314-4e04-bff6-38ba9917f051 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:37.516149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d1cb7-c314-4e04-bff6-38ba9917f051 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:37.518049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 79/168] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:37 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:37.519778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5279a-90a7-48dc-ba9e-a911f6778bf5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.520217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5279a-90a7-48dc-ba9e-a911f6778bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.520627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5279a-90a7-48dc-ba9e-a911f6778bf5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.523765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 80/169] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:37.524700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5279a-90a7-48dc-ba9e-a911f6778bf5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:37.688518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:37.723781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25f10b-66d8-4781-a845-c4f5a5cbe59e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:37.731479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5279a-90a7-48dc-ba9e-a911f6778bf5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:37.793627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41406d-480a-412f-9bfd-5de798c4f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:37.793627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41406d-480a-412f-9bfd-5de798c4f323 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.793627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41406d-480a-412f-9bfd-5de798c4f323 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.793627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41406d-480a-412f-9bfd-5de798c4f323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.829822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:37.830480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:37.831020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:37.831303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:37.860280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41406d-480a-412f-9bfd-5de798c4f323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:37.861816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41406d-480a-412f-9bfd-5de798c4f323 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:37.947527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:37.968272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:38.020151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 81/170] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:38.021647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb631a-e8e2-43ad-aedf-ed3bf7d33435 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.022077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb631a-e8e2-43ad-aedf-ed3bf7d33435 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.026117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:38.027761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:38.029472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb631a-e8e2-43ad-aedf-ed3bf7d33435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.048232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-88cb631a-e8e2-43ad-aedf-ed3bf7d33435 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:38.049336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-88cb631a-e8e2-43ad-aedf-ed3bf7d33435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:38.127158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 82/171] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:38.128238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dfae-5a8d-4948-92b5-ae1dd586ee68 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.128704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dfae-5a8d-4948-92b5-ae1dd586ee68 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.128887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dfae-5a8d-4948-92b5-ae1dd586ee68 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.131017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 83/172] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:38.131885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304dfae-5a8d-4948-92b5-ae1dd586ee68 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.161361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 90/173] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:38.162779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.246011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:38.281636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf488ff-78e3-4293-aba8-71f61966ece9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:38.323293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0c30f-ad77-44a4-aac2-1be527455aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:38.323860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c30f-ad77-44a4-aac2-1be527455aad None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.324146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c30f-ad77-44a4-aac2-1be527455aad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.324424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0c30f-ad77-44a4-aac2-1be527455aad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.336673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0c30f-ad77-44a4-aac2-1be527455aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-48f0c30f-ad77-44a4-aac2-1be527455aad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:38.343034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:38.345494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:38.347470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 91/174] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:38.349613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:38.349835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed344-140d-4bed-a337-53b831503fbc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.349835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed344-140d-4bed-a337-53b831503fbc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.349835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed344-140d-4bed-a337-53b831503fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.358186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304dfae-5a8d-4948-92b5-ae1dd586ee68 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:38.368568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-233ed344-140d-4bed-a337-53b831503fbc None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:38.369785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-233ed344-140d-4bed-a337-53b831503fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:38.448721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 92/175] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:38.449542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed344-140d-4bed-a337-53b831503fbc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.470304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:38.470947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.471225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.471493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.478598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:38.480121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:38.481847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 84/176] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:38.482632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.531239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:38.618300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed344-140d-4bed-a337-53b831503fbc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:38.641955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaafc6-56ae-4ed6-8f56-e8853266dd9a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:38.654839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:38.655589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.655919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.656414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] PATH_INFO: `/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.657417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] RBAC: Authorizing `identity:get_project(project_id=19b4e9edc5134c3a8b9263fb0bd53076)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:38.659157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:38.666162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 93/177] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/projects/19b4e9edc5134c3a8b9263fb0bd53076 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:38.666162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.682134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:38.682826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.683020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.683294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.683962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:38.684418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:38.685623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7921c-d661-42e1-9c08-dce8e23a78fe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:38.697910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 85/178] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:38.700173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b0b3-c769-4c07-897c-6bbe003e1601 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.700464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b0b3-c769-4c07-897c-6bbe003e1601 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.700781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11b0b3-c769-4c07-897c-6bbe003e1601 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.702114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 86/179] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:38.706388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b0b3-c769-4c07-897c-6bbe003e1601 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.733673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:38.778673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d6f96-a7d9-4c63-8988-714e2d890a77 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:38.804643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:38.813300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:38.813958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.814239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.814514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.815247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11b0b3-c769-4c07-897c-6bbe003e1601 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:38.815342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=8f6560bddfbf45d5a00b083ee16509c1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:38.815552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:38.816981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aca78-dfc9-47ec-981e-667ee6b59ab0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:38.823370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 94/180] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/role_assignments?user.id=8f6560bddfbf45d5a00b083ee16509c1&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:38.824639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d449fc-9c14-493d-a4d4-e1f9f710b7b9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.825010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d449fc-9c14-493d-a4d4-e1f9f710b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.825401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d449fc-9c14-493d-a4d4-e1f9f710b7b9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.826825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 95/181] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:38.827538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d449fc-9c14-493d-a4d4-e1f9f710b7b9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.909513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:38.910096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:38.910379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:38.910655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:38.923245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:38.928338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:38.929291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:38.930120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 87/182] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:38.931269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:38.954655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d449fc-9c14-493d-a4d4-e1f9f710b7b9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.002953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.002953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.003241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.003407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.004431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=19b4e9edc5134c3a8b9263fb0bd53076, user.id=8f6560bddfbf45d5a00b083ee16509c1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:39.004431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.007435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1c642-94d2-4d2d-91c3-53f44249c14a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.017914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 96/183] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/role_assignments?user.id=8f6560bddfbf45d5a00b083ee16509c1&scope.project.id=19b4e9edc5134c3a8b9263fb0bd53076&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.017914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1801ed-851d-4c07-bbdb-37a59830e32e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.017914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1801ed-851d-4c07-bbdb-37a59830e32e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.017914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1801ed-851d-4c07-bbdb-37a59830e32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.037403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7e1801ed-851d-4c07-bbdb-37a59830e32e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:39.039775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7e1801ed-851d-4c07-bbdb-37a59830e32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:39.046257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.060887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f696157-e82d-4bea-a8c1-865c0c0beb3d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.103174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.103823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.104108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.104381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] PATH_INFO: `/v3/users/8f6560bddfbf45d5a00b083ee16509c1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.105600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6560bddfbf45d5a00b083ee16509c1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.107112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.108755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 88/184] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:38 2022] GET /identity/v3/users/8f6560bddfbf45d5a00b083ee16509c1 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.110235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.114490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.128566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 97/185] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:39.137364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.137364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.137364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.151987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:39.153479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:39.247694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ee2cc-fb33-4404-b16e-82839038acd1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.248762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 98/186] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:39.249800 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.299309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.299943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.300225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.300497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.317992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:39.324402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:39.325299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:39.326156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:39.331349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 89/187] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:39.331349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.347971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.379998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ba871-74df-49aa-b664-5abf1fb8c910 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.407726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.428874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.429487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.429765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.430069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.430732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:39.431034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.432396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.442006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 99/188] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.443401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.449657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9fa9c-65ec-4563-935f-b2ecad3b0d7b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.485827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.486677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.487107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.487547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.553785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadd66c-6bc0-4312-90dd-1531545d803c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.560306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.561768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.578271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.587376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.594049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.594049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.594049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.594049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:39.594049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.594049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.598944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 100/189] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.600368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.640704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.662689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 90/190] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:39.663529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.698803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652992c-c5fd-4488-9a2a-c9b2e77cdae1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.732528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.733153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.733429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.733708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.743590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:39.748677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:39.749534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 101/191] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:39.756201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.765001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8a4cb-37ff-462e-a4b0-82d130500dd3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.781438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.799209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.799843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.800126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.800406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] PATH_INFO: `/v3/users/df18c11367594d8c84a2ef5f2a60b948` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.814186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=df18c11367594d8c84a2ef5f2a60b948)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.815589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.817578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 91/192] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/users/df18c11367594d8c84a2ef5f2a60b948 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.819162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.854654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:39.857648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b94c6d-d281-4f25-b030-08a3df6ccf64 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.892962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.893585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.893880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.894159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.895257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.897722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.900084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 102/193] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.901033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:39.922041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14335e97-731f-41ce-85da-d2eac214a7a3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:39.955939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:39.956558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:39.956842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:39.957115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] PATH_INFO: `/v3/users/4524101cb3eb44edbfbb9aa1a01bcc83` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:39.958982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] RBAC: Authorizing `identity:get_user(user_id=4524101cb3eb44edbfbb9aa1a01bcc83)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:39.960525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:39.962131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 92/194] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/users/4524101cb3eb44edbfbb9aa1a01bcc83 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:39.962131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.005101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a8302-00ef-4ff9-871d-6464fc100275 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.006906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.040590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.041585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.041997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.042172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.043448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.044889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.046550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 103/195] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:40.050683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.064456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369cbba-c9a3-4009-b567-535191a3f85e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.086557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.098517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.099346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.099666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.099935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.100595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:40.100902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.102396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.110414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 93/196] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:17:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:40.111240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.154023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247f7fb-21ba-4ceb-92f2-b40849b97703 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.187606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.188211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.188489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.188761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.210803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e5680-081d-44e9-87fd-4ec4efb887e5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.213490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.244984 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822444be-3723-416b-a002-4b497111f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.245580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822444be-3723-416b-a002-4b497111f279 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.245886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822444be-3723-416b-a002-4b497111f279 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.246159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822444be-3723-416b-a002-4b497111f279 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.246794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822444be-3723-416b-a002-4b497111f279 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.248226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822444be-3723-416b-a002-4b497111f279 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.256279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.257862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.290212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.346198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 94/197] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:40 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:40.346954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822444be-3723-416b-a002-4b497111f279 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.357182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 104/198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:40.357182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.466390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41bc9-75b5-4ec9-9873-a2b40785e870 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.466625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822444be-3723-416b-a002-4b497111f279 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.503913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.504516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.504797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.505066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.506792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] RBAC: Adding query filter params (role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=8f6560bddfbf45d5a00b083ee16509c1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:40.507129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.509077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.511258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.511389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.511588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.511856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.513021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.517564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 105/199] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/role_assignments?user.id=8f6560bddfbf45d5a00b083ee16509c1&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=402534b8089045d3acf4ac1379844e80 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:40.518311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.549381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.620081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.621678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.673023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a491a-535f-4073-98df-20552d462a50 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.722585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.723464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.724464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.724882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] PATH_INFO: `/v3/users/df18c11367594d8c84a2ef5f2a60b948` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.726262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] RBAC: Authorizing `identity:get_user(user_id=df18c11367594d8c84a2ef5f2a60b948)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.727881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.729477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 106/200] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/users/df18c11367594d8c84a2ef5f2a60b948 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:40.730426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.775279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 95/201] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:40.776694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.817121 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.859278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:40.865306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3b103-d6d9-47f8-87f9-2e6e21ddfe77 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.910293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.911267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.912310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.912902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:40.914326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:40.915979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:40.917652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7b5ca-70b1-4398-8d00-0e26a3bec49b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:40.918108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 107/202] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:40.919098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:40.967849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:40.968472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:40.968758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:40.969033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:41.038292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b333f-8e54-48b4-b86f-50685090f2c7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:41.063145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:41.065117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:41.076816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:41.078254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:41.078762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:41.079238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:41.080955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:41.082748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:41.084742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 108/203] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:41.085726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:41.090824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:41.141299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:41.198034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 96/204] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:41.199217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:41.212903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107f543-a7a0-41de-96ee-9bac59b624fe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:41.266877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:41.267504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:41.267792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:41.268075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:41.269080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=df18c11367594d8c84a2ef5f2a60b948) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:41.269400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:41.272337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:41.280130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 109/205] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:41 2022] GET /identity/v3/role_assignments?user.id=df18c11367594d8c84a2ef5f2a60b948&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:41.281408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:41.322747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28823ff5-640d-427c-b534-4e721135c427 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:41.368312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:41.385742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:41.387015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:41.387505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:41.387987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:41.389168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] RBAC: Adding query filter params (role.id=b2b4db89dc10402c80dbb7a173382ec3, scope.project.id=451e90a11827408c85a7bb4e2f02090f, user.id=4524101cb3eb44edbfbb9aa1a01bcc83) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:41.389701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:41.394246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:41.408247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 97/206] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:41 2022] GET /identity/v3/role_assignments?user.id=4524101cb3eb44edbfbb9aa1a01bcc83&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=b2b4db89dc10402c80dbb7a173382ec3 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:41.430718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d58f-9434-4acc-884b-812c7c51de4b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:41.473533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4641d9-c8a5-4102-94c9-ca027e25aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:41.474661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4641d9-c8a5-4102-94c9-ca027e25aead None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:41.475252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4641d9-c8a5-4102-94c9-ca027e25aead None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:41.475731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4641d9-c8a5-4102-94c9-ca027e25aead None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:41.477070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4641d9-c8a5-4102-94c9-ca027e25aead None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:41.478761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4641d9-c8a5-4102-94c9-ca027e25aead None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:41.480617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 110/207] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:41 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:41.487032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:41.518396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:41.603078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f1e8-b6e0-4376-b0fd-28f80f265e6e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:41.650801 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:41.651720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:41.652153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:41.652574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:41.653475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] RBAC: Adding query filter params (role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=df18c11367594d8c84a2ef5f2a60b948) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:41.653976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:41.655687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518c89-3773-4775-9593-7d42c360f4e4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:41.667100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 98/208] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:41 2022] GET /identity/v3/role_assignments?user.id=df18c11367594d8c84a2ef5f2a60b948&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=402534b8089045d3acf4ac1379844e80 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:42.675224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cac10a-cce7-4ed5-b286-1ce21ec00636 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:42.675774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cac10a-cce7-4ed5-b286-1ce21ec00636 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:42.675774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cac10a-cce7-4ed5-b286-1ce21ec00636 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:42.677564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 111/209] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:42.682877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:42.683297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:42.683479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:42.702750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:42.703999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:42.759231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfb2c0-e2a2-47e7-99f6-e3f97f17795c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:42.759539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfb2c0-e2a2-47e7-99f6-e3f97f17795c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:42.759798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfb2c0-e2a2-47e7-99f6-e3f97f17795c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:42.761412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 112/210] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:42.767087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:42.767395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:42.767653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:42.776764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 99/211] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:42.788415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:42.789695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:42.873872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 113/212] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:43.073112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.092808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.150655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.184681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02039d9-8f56-4c29-848e-790180e23a97 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.232675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.234468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.235364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.236137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.236615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.251496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:43.256463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:43.257373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:43.258200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:43.265351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 100/213] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:43.266443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.275699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e133c0e-ec87-4f3c-98f8-de6ac722d262 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.323370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbdfcc-057c-46e3-be63-9ce2c22c5c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.324038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbdfcc-057c-46e3-be63-9ce2c22c5c13 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.324915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbdfcc-057c-46e3-be63-9ce2c22c5c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.325276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbdfcc-057c-46e3-be63-9ce2c22c5c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.326781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbdfcc-057c-46e3-be63-9ce2c22c5c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:43.328620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbdfcc-057c-46e3-be63-9ce2c22c5c13 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:43.331103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 114/214] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:43.335284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dfd38-85f7-41e4-ac64-0c6e866823ff None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.335284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dfd38-85f7-41e4-ac64-0c6e866823ff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.335463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7dfd38-85f7-41e4-ac64-0c6e866823ff None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.336995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 115/215] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:43.337691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dfd38-85f7-41e4-ac64-0c6e866823ff None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.364876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.386917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67ed7-429d-4f1e-bc0f-5d4149544546 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.423729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.424341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.424624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.424898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.425563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:43.425889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:43.427344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdffc1-04fe-40fe-8718-58b9e851a6a9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:43.436280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 101/216] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:43.437787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.438120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.438396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.457420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:43.459290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:43.465215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7dfd38-85f7-41e4-ac64-0c6e866823ff None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.500891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af60655-3131-4796-bac2-e6309d9aa533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.501495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af60655-3131-4796-bac2-e6309d9aa533 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.501775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af60655-3131-4796-bac2-e6309d9aa533 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.502088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af60655-3131-4796-bac2-e6309d9aa533 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.502729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af60655-3131-4796-bac2-e6309d9aa533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:43.504279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af60655-3131-4796-bac2-e6309d9aa533 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:43.512770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.530478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 102/217] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:43.531336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.609105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.624924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 116/218] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:43 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:43.629263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba4b5-85cd-4c85-91bd-9a0b4354dbc8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.629263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba4b5-85cd-4c85-91bd-9a0b4354dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.629263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba4b5-85cd-4c85-91bd-9a0b4354dbc8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.629263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 117/219] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:43.633821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.634155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.634424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.653879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:43.654073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa467-b64e-44cf-be0c-d1990b19eaab None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.655230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:43.693084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.693791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.694110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.694382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] PATH_INFO: `/v3/users/8d45edc22cd542088bfe46066479b1f9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.710244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] RBAC: Authorizing `identity:get_user(user_id=8d45edc22cd542088bfe46066479b1f9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:43.711832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:43.713711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 103/220] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:43 2022] GET /identity/v3/users/8d45edc22cd542088bfe46066479b1f9 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:43.719687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.736316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 118/221] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:43.806877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:43.849731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174641bb-ad99-412e-aadc-01d847195c22 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.920985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.934589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6b0ab-0546-41bb-a560-fe19d3ce90d9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:43.937213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.937896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.938180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.938461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.961650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:43.982408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:43.983051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:43.983375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:43.983686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:43.997575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:44.002528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:44.003587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:44.004561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 119/222] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:44.012730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.044531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.046328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.144646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6ccb6-c491-45df-b75c-9237a5d4e731 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.172622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 104/223] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:44.174243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.186200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.186811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.187090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.187371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.188037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:44.188338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.190017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.199559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 120/224] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.200468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.212175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:44.246472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:44.308490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213f5ac-d127-4025-b994-3187149d3208 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.310752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038150cf-45f4-4b22-9bcc-28801427ef9e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.344143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.344964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.345340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.345710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.347145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.348710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.351433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 121/225] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.352157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.360372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.362147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.362608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.363034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.376210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:44.382733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:44.383783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:44.384564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:44.392351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 105/226] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:44.392351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.475089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610efb6-c4e9-4cc4-8fb7-57a82ce55e37 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.508327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:44.511959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:44.513539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.514493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.514978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.515453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] PATH_INFO: `/v3/users/df18c11367594d8c84a2ef5f2a60b948` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.516828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] RBAC: Authorizing `identity:get_user(user_id=df18c11367594d8c84a2ef5f2a60b948)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.518630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.520870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 122/227] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/users/df18c11367594d8c84a2ef5f2a60b948 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.522072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.529817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a381cc-9a3a-4641-8bce-57a68cbab814 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.568851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.569833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.570428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.570908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.571891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=8d45edc22cd542088bfe46066479b1f9) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:44.572369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.574054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.581817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 106/228] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/role_assignments?user.id=8d45edc22cd542088bfe46066479b1f9&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.581817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.669845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80a03-a4f3-4fed-9e06-c0756d4b97fe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.740126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.742414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.743095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.744747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.746782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:44.748029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.749974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.765125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 123/229] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.766815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.772526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a84ad-d295-48dd-8241-e14b2b19b30d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.816625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.817520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.818333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.818612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.819769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:44.820522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.822797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.824847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 107/230] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.830677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.882235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:44.886766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188dde-de22-452d-abd6-1b4f33ef791c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:44.929678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:44.930354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:44.930636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:44.930911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] PATH_INFO: `/v3/users/df18c11367594d8c84a2ef5f2a60b948` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:44.933774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] RBAC: Authorizing `identity:get_user(user_id=df18c11367594d8c84a2ef5f2a60b948)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:44.935260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:44.937063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 124/231] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/users/df18c11367594d8c84a2ef5f2a60b948 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:44.943445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:44.998728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2892-6bf7-4594-b8ef-423a328523c4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:45.043917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:45.044613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:45.044897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:45.045178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/df18c11367594d8c84a2ef5f2a60b948/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:45.051813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35e43fe63da45b880d2d6fee878a32e, user_id=df18c11367594d8c84a2ef5f2a60b948, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:45.055439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:45.119166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0875-ac95-48e5-81e6-6ab3535a743c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:45.131350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:45.143764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 108/232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:44 2022] PUT /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/df18c11367594d8c84a2ef5f2a60b948/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:17:45.163725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e6f33-5473-4f99-a44e-8a9d78aaf7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:45.164384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6f33-5473-4f99-a44e-8a9d78aaf7ed None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:45.164722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6f33-5473-4f99-a44e-8a9d78aaf7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:45.165042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e6f33-5473-4f99-a44e-8a9d78aaf7ed None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:45.166302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e6f33-5473-4f99-a44e-8a9d78aaf7ed None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:45.167848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e6f33-5473-4f99-a44e-8a9d78aaf7ed None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:45.169967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 125/233] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:44 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:45.175821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:45.268813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:45.290612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513231c-963b-452f-8a55-e5c8d8451755 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:45.328001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d3ae3-ab5e-4fc3-b2d0-be86b6dca1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:45.328722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d3ae3-ab5e-4fc3-b2d0-be86b6dca1be None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:45.329014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d3ae3-ab5e-4fc3-b2d0-be86b6dca1be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:45.329292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d3ae3-ab5e-4fc3-b2d0-be86b6dca1be None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/df18c11367594d8c84a2ef5f2a60b948/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:45.331807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d3ae3-ab5e-4fc3-b2d0-be86b6dca1be None admin] RBAC: Authorizing `identity:create_grant(project_id=c35e43fe63da45b880d2d6fee878a32e, user_id=df18c11367594d8c84a2ef5f2a60b948, role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:45.338979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d3ae3-ab5e-4fc3-b2d0-be86b6dca1be None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:45.463709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 109/234] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:45 2022] PUT /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/df18c11367594d8c84a2ef5f2a60b948/roles/402534b8089045d3acf4ac1379844e80 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:45.983544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846332be-7019-4e1d-849c-8e891d3dd94c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:45.984098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846332be-7019-4e1d-849c-8e891d3dd94c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:45.984098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846332be-7019-4e1d-849c-8e891d3dd94c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:45.985453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 126/235] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:45.992312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:45.992845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:45.992845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:46.009238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418d8f-0925-44d8-943e-f316d55391e7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:46.009556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418d8f-0925-44d8-943e-f316d55391e7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:46.009794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418d8f-0925-44d8-943e-f316d55391e7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:46.011426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 127/236] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:46.025629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:46.026856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:46.030411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:46.030695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:46.030968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:46.057000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:46.058230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:46.153782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 110/237] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:46.177325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 128/238] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:46.445939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:46.541896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:46.584794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:46.586558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9d3a-3441-44a1-bf0c-ca7bd9cbfa89 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:46.639461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:46.640465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:46.640981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:46.641470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:46.643356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:46.645031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:46.647810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 111/239] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:46.652870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:46.777336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0f7eb-cf1a-4d6a-8879-5ff3f6d6a926 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:46.787075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:46.824815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:46.825733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:46.826414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:46.826889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:46.861996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:46.867724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:46.868613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:46.869387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 129/240] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:46.877404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002ada-67e2-4fe0-a330-f69cdfc6713e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:46.878856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:46.915856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfadb70-0bad-4942-8300-963cb48ec490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:46.916826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadb70-0bad-4942-8300-963cb48ec490 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:46.917339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadb70-0bad-4942-8300-963cb48ec490 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:46.917816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadb70-0bad-4942-8300-963cb48ec490 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:46.918816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfadb70-0bad-4942-8300-963cb48ec490 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:46.920610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfadb70-0bad-4942-8300-963cb48ec490 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:46.932449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:47.024802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f1cd-9a9d-45d8-a56a-c3a56f8c6688 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:47.045388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 112/241] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:46 2022] POST /identity/v3/users => generated 293 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:47.047281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9b97e-e119-4c27-b7d5-9034dd8842a7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.047746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9b97e-e119-4c27-b7d5-9034dd8842a7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.048237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9b97e-e119-4c27-b7d5-9034dd8842a7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.049791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 113/242] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:47.057494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.058294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.058749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.090193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:47.091342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.091841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.092286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.094300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:47.094809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:47.096907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:47.098212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:47.102547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:47.117618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 130/243] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:47.123558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:47.158287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:47.238174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c572eaf-6c79-4ac9-b7d3-51424629e9fa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:47.248520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 114/244] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:47.293850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b14b1-bdd7-4ca4-986e-d72d1cd0caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:47.294570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b14b1-bdd7-4ca4-986e-d72d1cd0caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.294850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b14b1-bdd7-4ca4-986e-d72d1cd0caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.295128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b14b1-bdd7-4ca4-986e-d72d1cd0caa7 None admin] PATH_INFO: `/v3/users/4c4e37c29be548acbfa406c53cf02993` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.311831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b14b1-bdd7-4ca4-986e-d72d1cd0caa7 None admin] RBAC: Authorizing `identity:get_user(user_id=4c4e37c29be548acbfa406c53cf02993)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:47.313216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b14b1-bdd7-4ca4-986e-d72d1cd0caa7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:47.315322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 131/245] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:47 2022] GET /identity/v3/users/4c4e37c29be548acbfa406c53cf02993 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:47.320979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:47.425663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72c574-730e-46ed-b237-b6212b39d3bf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:47.450959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:47.461971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:47.462592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.462872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.463146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.532750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:47.534260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:47.554504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c71d5d-54b5-4bb8-bcd6-28f3a98067d9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.554806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c71d5d-54b5-4bb8-bcd6-28f3a98067d9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.555053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c71d5d-54b5-4bb8-bcd6-28f3a98067d9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.556651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 132/246] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:47.563120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.563415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.563691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.586633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:47.587780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:47.658982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 115/247] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:47.660632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:47.682369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 133/248] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:47.683145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:47.689774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:47.706608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:47.781754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e05b6-2b85-40df-8381-2b694df6ac6f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:47.815620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af93e34-8f69-4deb-9311-68419cccbd18 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:47.836205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:47.837162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.837628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.838105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.862903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:47.868998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:47.870023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:47.871251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 116/249] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:47.874560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:47.875216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:47.875503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:47.875777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:47.876055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:47.876957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:47.878452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:47.881242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 134/250] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:47 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:47.887769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:47.982864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:48.000339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a249f-0786-4488-a373-e81920b3f3a7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.041511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.042507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.042989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.043474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.045459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:48.046110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.048858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a1d76-4385-46da-b7df-d95ab34a0826 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.063894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 117/251] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:48.065164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8585d47-4022-4869-9fc0-f07987ca346f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.065447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8585d47-4022-4869-9fc0-f07987ca346f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.065774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8585d47-4022-4869-9fc0-f07987ca346f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.072563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 118/252] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:48.074395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8585d47-4022-4869-9fc0-f07987ca346f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.091641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:48.123397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac8eee-ef3c-4ed1-871f-78da884e522c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.158633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.159271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.159548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.159820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.160548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] RBAC: Adding query filter params (role.id=b2b4db89dc10402c80dbb7a173382ec3, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=4c4e37c29be548acbfa406c53cf02993) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:48.160853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.163251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a833039-6d12-4c8e-abfe-7470ffa0ca4c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.169267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 135/253] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:47 2022] GET /identity/v3/role_assignments?user.id=4c4e37c29be548acbfa406c53cf02993&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=b2b4db89dc10402c80dbb7a173382ec3 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:48.170477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.170764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.171038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.194303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:48.195543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:48.224264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8585d47-4022-4869-9fc0-f07987ca346f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.270295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 136/254] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:48.271654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.296097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.296766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.297055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.297337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] PATH_INFO: `/v3/users/8d45edc22cd542088bfe46066479b1f9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.299974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] RBAC: Authorizing `identity:get_user(user_id=8d45edc22cd542088bfe46066479b1f9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.301482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.305968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 119/255] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/users/8d45edc22cd542088bfe46066479b1f9 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:48.311276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.339665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:48.370468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:48.393779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721d92-9264-444c-9b13-ea8baf170e10 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.438841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.439653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.439951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.440230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.453253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:48.459184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:48.460265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:48.461043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 137/256] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:48.475713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.513662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81d942-be18-4cee-85ce-a00175c1dd7f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.550876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.551510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.551851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.552184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.553375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.554859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.557816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 120/257] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:48.577351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.601343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b231cf-c65f-4103-9d80-920c581aeff3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.639534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.640559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.641063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.641558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.642817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:48.643373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.646561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.652083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:48.656139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 138/258] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:48.662678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.723223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:48.753277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20548-f9ae-4804-8a03-53cfbe1efedf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.774060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ed15c-ea2f-4767-8d4f-6e6bc2c66185 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:48.822531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.825421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.825421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.825421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/8d45edc22cd542088bfe46066479b1f9/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.827474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35e43fe63da45b880d2d6fee878a32e, user_id=8d45edc22cd542088bfe46066479b1f9, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.828983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.841260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:48.841922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:48.842206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:48.842472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] PATH_INFO: `/v3/users/df18c11367594d8c84a2ef5f2a60b948` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:48.843662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] RBAC: Authorizing `identity:get_user(user_id=df18c11367594d8c84a2ef5f2a60b948)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:48.845105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:48.846993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 139/259] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/users/df18c11367594d8c84a2ef5f2a60b948 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:48.847764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:48.926605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 121/260] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:48 2022] PUT /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/8d45edc22cd542088bfe46066479b1f9/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:48.927994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:49.004078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:49.056468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d294c6-6542-4be6-9953-805bc7edb270 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.152669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.153331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.153611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.153882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:49.155808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea8f70-d2ee-43ce-befe-7aa85b85b3c1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.186762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:49.192040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:49.193596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:17:49.194587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:49.196469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 140/261] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:49.201881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.202501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.202783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.203026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:49.203193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:49.220601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:49.278205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:49.279670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:49.389329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 122/262] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:49.397523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:49.441678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54f389-6a51-41f0-a7f2-43839165b1af None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.451495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:49.484994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:49.501581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.502243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.502523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.502795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:49.503478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:49.503781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:49.505486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:49.507339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d54b6-dd4b-4dfe-8ab7-057ab4aaeab3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.526719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 141/263] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:17:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:49.530229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:49.564117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.565113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.565597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.566140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:49.569650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:49.571390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:49.573549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 123/264] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:49 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:49.580678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:49.654695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03daf14-afb2-4bbe-92a8-474aefbd6e5e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.701693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.702377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.702743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.703087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] PATH_INFO: `/v3/users/df18c11367594d8c84a2ef5f2a60b948` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:49.704487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] RBAC: Authorizing `identity:get_user(user_id=df18c11367594d8c84a2ef5f2a60b948)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:49.706682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:49.709417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 142/265] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:49 2022] GET /identity/v3/users/df18c11367594d8c84a2ef5f2a60b948 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:49.714951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:49.726366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13f00a-df8f-420a-9259-df2ee410bd12 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.738256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:49.764419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.765085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.765381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.765660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:49.766432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=df18c11367594d8c84a2ef5f2a60b948) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:49.766751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:49.769920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:49.775354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 124/266] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:49 2022] GET /identity/v3/role_assignments?user.id=df18c11367594d8c84a2ef5f2a60b948&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:49.824526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:49.891961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e42d8-2c5d-4dcd-bdbd-69db9bb8ac8c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:49.938774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff36c8-76d9-422e-a2b7-af9eaa7c5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:49.939399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff36c8-76d9-422e-a2b7-af9eaa7c5718 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:49.939681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff36c8-76d9-422e-a2b7-af9eaa7c5718 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:49.939956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff36c8-76d9-422e-a2b7-af9eaa7c5718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.023624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff36c8-76d9-422e-a2b7-af9eaa7c5718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:50.025095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff36c8-76d9-422e-a2b7-af9eaa7c5718 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:50.094494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:50.152044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 143/267] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:17:50.157910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:50.273074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc214cd-5e07-4f60-bed5-f7108fa836c9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:50.295275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0876f-c160-45ce-b1bb-8aa5cfa78c4e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.295876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0876f-c160-45ce-b1bb-8aa5cfa78c4e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.295876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0876f-c160-45ce-b1bb-8aa5cfa78c4e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.297255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 144/268] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:17:50.302767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef978-84bf-46b8-b51d-0d8ac8e41717 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.303051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef978-84bf-46b8-b51d-0d8ac8e41717 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.303331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef978-84bf-46b8-b51d-0d8ac8e41717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.314677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:50.315316 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.315605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.315878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.319315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:50.320790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:50.322770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 125/269] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:50 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:50.328531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:50.334639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-20bef978-84bf-46b8-b51d-0d8ac8e41717 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:50.335825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-20bef978-84bf-46b8-b51d-0d8ac8e41717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:50.376530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:50.441020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225631ed-fd28-433c-8a48-2581121c1656 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:50.475751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 145/270] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:50.481285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:50.481924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.482212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.482490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.483229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] RBAC: Adding query filter params (role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=df18c11367594d8c84a2ef5f2a60b948) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:50.483543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:50.485099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec6ba6-d140-4259-9382-f6413670e674 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:50.491652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 126/271] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:50 2022] GET /identity/v3/role_assignments?user.id=df18c11367594d8c84a2ef5f2a60b948&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=402534b8089045d3acf4ac1379844e80 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:50.613254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780d999-62d2-46a9-832f-51f76197fcc4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.613561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780d999-62d2-46a9-832f-51f76197fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.613717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780d999-62d2-46a9-832f-51f76197fcc4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.616045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 146/272] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:50.621894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.622173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.622459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:50.642583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:50.643785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:50.716746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 127/273] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:50.840506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780d999-62d2-46a9-832f-51f76197fcc4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:50.942607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:50.958161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780d999-62d2-46a9-832f-51f76197fcc4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:50.995383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:50.996017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:50.996299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:50.996573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.011122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:51.016139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:51.018354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:51.020980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 147/274] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:51.025098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.052043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.068965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:51.139893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b041364-a749-427a-a0bc-1341458dac0f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.162862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59895e3a-6e29-4623-9e7c-74863ba31221 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.176675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.177951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.178399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.178813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.179722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:51.180257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:51.181752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9ff14-292f-469a-ac71-909e8d88e680 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:51.196400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 128/275] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:51.197246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9198-ba03-4542-a71e-08feb3e88f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.197896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9198-ba03-4542-a71e-08feb3e88f85 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.198181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9198-ba03-4542-a71e-08feb3e88f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.198452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9198-ba03-4542-a71e-08feb3e88f85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.198624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb73bb-822d-45e5-844e-4370d3486c9b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.199038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb73bb-822d-45e5-844e-4370d3486c9b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.199444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb73bb-822d-45e5-844e-4370d3486c9b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.199549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f9198-ba03-4542-a71e-08feb3e88f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:51.200928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 129/276] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:51.201032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f9198-ba03-4542-a71e-08feb3e88f85 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:51.201942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb73bb-822d-45e5-844e-4370d3486c9b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.206900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 148/277] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:51.208901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.209365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.209644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.227709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:51.228883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:51.240447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:51.298816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 149/278] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:51.299547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.323780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:51.330941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb73bb-822d-45e5-844e-4370d3486c9b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.378712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.379892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.380371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.380930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] PATH_INFO: `/v3/users/fb8d655ac72e48aa834caaf83533dd34` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.399485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] RBAC: Authorizing `identity:get_user(user_id=fb8d655ac72e48aa834caaf83533dd34)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:51.401948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:51.409540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 130/279] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/users/fb8d655ac72e48aa834caaf83533dd34 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:51.411454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.415434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a6e0-b1b5-4c99-9c65-a56c955dfa4a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.452092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04197250-1872-4b4d-ade0-5866610e423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.452574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197250-1872-4b4d-ade0-5866610e423b None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.452861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197250-1872-4b4d-ade0-5866610e423b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.453133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197250-1872-4b4d-ade0-5866610e423b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.453811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04197250-1872-4b4d-ade0-5866610e423b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:51.455502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04197250-1872-4b4d-ade0-5866610e423b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:51.533556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c105a-7081-447b-9003-9be2ead81258 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.570926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.571536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.571817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.572091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.572814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, user.id=fb8d655ac72e48aa834caaf83533dd34, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:51.573120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:51.574745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:51.580719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 131/280] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/role_assignments?user.id=fb8d655ac72e48aa834caaf83533dd34&scope.system=all&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:51.581508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.602320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 150/281] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:17:51 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:51.624358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:51.643737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ed76-04f0-4155-81af-56e1c8bd24f9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.644585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ed76-04f0-4155-81af-56e1c8bd24f9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.645100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ed76-04f0-4155-81af-56e1c8bd24f9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.648299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 151/282] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:51.656317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.656919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.657354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.665824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:51.681661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:51.683599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:51.719045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1d5c0-538b-48b7-97a9-012897035095 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.763594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.764529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.764809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.765082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.775085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 152/283] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:51.778790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:51.783670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:51.784741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:51.786438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 132/284] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:51.791483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:51.910170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f03a2-bfee-4117-8d85-011cede6c6b4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:51.943796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:51.949388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:51.952391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:51.952391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:51.952391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:51.952391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:51.952391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:51.953075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:51.963274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 153/285] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:51.968352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.067122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.081175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:52.108268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7ecb2-bb26-4871-ba17-cfea892f6f30 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:52.175687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:52.176329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:52.177294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:52.178133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] PATH_INFO: `/v3/users/4c4e37c29be548acbfa406c53cf02993` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:52.181611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] RBAC: Authorizing `identity:get_user(user_id=4c4e37c29be548acbfa406c53cf02993)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:52.183103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:52.186039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 133/286] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:51 2022] GET /identity/v3/users/4c4e37c29be548acbfa406c53cf02993 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:52.190634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.227259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f6ee7-5b65-4841-a952-52882ec14169 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:52.271932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:52.272566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:52.272843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:52.273120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:52.297392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:52.302944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:52.304238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:52.305015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:52.305598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 154/287] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:52.314029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.395371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26295158-a247-44a9-9d3a-3192fce50565 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:52.416880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:52.461347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:52.462028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:52.462308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:52.462578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:52.463711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:52.465169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:52.468212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 134/288] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:52 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:52.474613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.497937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6951c7-c842-4433-ba1f-70322f1893a5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:52.510596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:52.559098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:52.559710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:52.559983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:52.560316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:52.560988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:52.561288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:52.562677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:52.577408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 155/289] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:52.584525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.621220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25778-2034-46c9-aaa0-6b42ec3ab3e8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:52.662016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:52.662571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:52.662855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:52.663122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/4c4e37c29be548acbfa406c53cf02993/roles/b2b4db89dc10402c80dbb7a173382ec3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:52.666000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35e43fe63da45b880d2d6fee878a32e, user_id=4c4e37c29be548acbfa406c53cf02993, role_id=b2b4db89dc10402c80dbb7a173382ec3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:52.667425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:52.743520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae02846-f651-4301-bc3f-77b584cdb60c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:52.760811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:52.773006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 135/290] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:17:52 2022] PUT /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e/users/4c4e37c29be548acbfa406c53cf02993/roles/b2b4db89dc10402c80dbb7a173382ec3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:52.795764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:52.796659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:52.797231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:52.797566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] PATH_INFO: `/v3/users/8d45edc22cd542088bfe46066479b1f9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:52.798797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] RBAC: Authorizing `identity:get_user(user_id=8d45edc22cd542088bfe46066479b1f9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:52.800344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:52.802950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 156/291] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:52 2022] GET /identity/v3/users/8d45edc22cd542088bfe46066479b1f9 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:52.809160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:52.927337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:52.962127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fedab-dda4-4d86-b324-aeda6a624409 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:53.007407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:53.008366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:53.008886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:53.009381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:53.085375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:53.087181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:53.169227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:53.200784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 136/292] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:53.201973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:53.352648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d95ab5-3a4a-430d-a398-1f2a9d50f1fb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:53.397794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444492d8-059a-44de-83c1-4c45fcfd738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:53.398506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444492d8-059a-44de-83c1-4c45fcfd738d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:53.398787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444492d8-059a-44de-83c1-4c45fcfd738d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:53.399062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444492d8-059a-44de-83c1-4c45fcfd738d None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:53.400190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444492d8-059a-44de-83c1-4c45fcfd738d None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:53.401611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444492d8-059a-44de-83c1-4c45fcfd738d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:53.403577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 157/293] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:53 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:53.409491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:53.556022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff44e-86c6-4951-b3bf-bf608fcee952 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:53.591670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:53.592279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:53.592566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:53.592843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:53.593579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=8d45edc22cd542088bfe46066479b1f9) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:53.593914 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:53.595350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9db8e-cc7b-49f0-ae12-5f1418513cc5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:53.602447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 137/294] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:53 2022] GET /identity/v3/role_assignments?user.id=8d45edc22cd542088bfe46066479b1f9&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:53.957445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13587516-40e5-4638-ac1d-0f0b97cbd9b2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:53.958447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13587516-40e5-4638-ac1d-0f0b97cbd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:53.958731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13587516-40e5-4638-ac1d-0f0b97cbd9b2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:53.960367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 158/295] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:53.965526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a1d1-684c-40d3-8841-0c82f88f2e86 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:53.965816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a1d1-684c-40d3-8841-0c82f88f2e86 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:53.966129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a1d1-684c-40d3-8841-0c82f88f2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:53.989580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b202a1d1-684c-40d3-8841-0c82f88f2e86 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:53.990899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b202a1d1-684c-40d3-8841-0c82f88f2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:54.034233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:54.075703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 138/296] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:54.136995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c80e-b70a-46b5-9765-bacd75ed824a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.137322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c80e-b70a-46b5-9765-bacd75ed824a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.137546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c80e-b70a-46b5-9765-bacd75ed824a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.139167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 159/297] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:54.144326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5b58-053b-47c8-afae-75376843a2df None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.144623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5b58-053b-47c8-afae-75376843a2df None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.144906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5b58-053b-47c8-afae-75376843a2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.167931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fbba5b58-053b-47c8-afae-75376843a2df None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:54.169135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fbba5b58-053b-47c8-afae-75376843a2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:54.255586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 139/298] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:54.269199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a9943-bde2-4178-9e44-9bee4d42c95b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.269481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a9943-bde2-4178-9e44-9bee4d42c95b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.269759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a9943-bde2-4178-9e44-9bee4d42c95b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.272190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 160/299] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:54.277385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.277677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.278015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.296231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:54.297423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:54.368329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 140/300] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:54.369438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a9943-bde2-4178-9e44-9bee4d42c95b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.430154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:54.479350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a9943-bde2-4178-9e44-9bee4d42c95b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:54.515930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:54.516559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.516835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.517110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.527169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.528289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:54.533097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:54.533991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:54.534788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 161/301] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:54.541813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.559215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:54.632427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87160eb6-aaaf-405d-86cc-b1b19bc80d61 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:54.655982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bbd98-ed36-4265-b718-812227e41bc6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:54.669669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:54.670366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.670651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.670932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.672055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:54.672204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:54.673486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:54.675092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 141/302] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:54.675858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.696799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:54.697996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.698488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.698944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.699830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:54.700719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:54.702808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:54.712979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 162/303] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:54.713780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.786244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:54.790079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cafd0-2ea8-4111-a3ae-cecf31963e78 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:54.818072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b96b7-a21f-46c6-8757-2a8f38cfb979 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:54.834601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:54.835509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.835979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.836357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.846990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:54.852220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:54.853093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:54.853913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 142/304] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:54.854578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.862180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:54.862797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:54.863078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:54.863352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] PATH_INFO: `/v3/groups` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:54.864850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:54.866331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:54.938412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 163/305] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Aug 24 09:17:54 2022] POST /identity/v3/groups => generated 229 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:17:54.939774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:54.975323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524bfde-4de9-430b-ae72-32b9293585a5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:54.982376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:55.026300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.027114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.027515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.027993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] PATH_INFO: `/v3/users/fb8d655ac72e48aa834caaf83533dd34` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.030269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] RBAC: Authorizing `identity:get_user(user_id=fb8d655ac72e48aa834caaf83533dd34)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:55.031856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:55.033994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 143/306] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:54 2022] GET /identity/v3/users/fb8d655ac72e48aa834caaf83533dd34 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:55.043710 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:55.069827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ce475-f210-40a9-b051-69cd54904f8e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:55.080669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:55.112885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.113201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.113445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.114275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.114938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:55.115230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:55.116687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26129e2-1b89-4753-8b52-b881ddd8c8eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:55.125313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 164/307] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:55.126655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff81bf-4609-432b-bd00-c91201422b63 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.126942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff81bf-4609-432b-bd00-c91201422b63 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.127212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff81bf-4609-432b-bd00-c91201422b63 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.128472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 165/308] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:55.130960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff81bf-4609-432b-bd00-c91201422b63 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:55.172677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d131-b92e-48c5-838f-4738eacdf14d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:55.211449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.212227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.212495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.212770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] PATH_INFO: `/v3/system/users/fb8d655ac72e48aa834caaf83533dd34/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.214263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fb8d655ac72e48aa834caaf83533dd34, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:55.215885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:55.228145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:55.234616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff81bf-4609-432b-bd00-c91201422b63 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:55.268603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784966b-1c32-4812-bf16-c3962452516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.269236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784966b-1c32-4812-bf16-c3962452516b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.269592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784966b-1c32-4812-bf16-c3962452516b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.269892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784966b-1c32-4812-bf16-c3962452516b None admin] PATH_INFO: `/v3/users/a54e589666624ddb97e088d8362229dd` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.283747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784966b-1c32-4812-bf16-c3962452516b None admin] RBAC: Authorizing `identity:get_user(user_id=a54e589666624ddb97e088d8362229dd)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:55.286748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784966b-1c32-4812-bf16-c3962452516b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:55.287616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 166/309] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:55 2022] GET /identity/v3/users/a54e589666624ddb97e088d8362229dd => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:55.288770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.289053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.289327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.306679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 144/310] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Aug 24 09:17:55 2022] PUT /identity/v3/system/users/fb8d655ac72e48aa834caaf83533dd34/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:17:55.307176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:55.307369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:55.308223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:55.393346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 167/311] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:55.436813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:55.448417 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbfa39-6d5f-4400-82a3-513527f7ac66 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:55.491854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.492386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.492668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.492970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.493701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] RBAC: Adding query filter params (role.id=b2b4db89dc10402c80dbb7a173382ec3, user.id=a54e589666624ddb97e088d8362229dd, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:55.494038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:55.495473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:55.501451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 145/312] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 24 09:17:55 2022] GET /identity/v3/role_assignments?user.id=a54e589666624ddb97e088d8362229dd&scope.system=all&role.id=b2b4db89dc10402c80dbb7a173382ec3 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:55.672129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:55.757554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:55.773365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de9e0-fc3c-449e-9833-014bc9b9871c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:55.810241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.810882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.811161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.811434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.825629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:55.830932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:55.831798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:55.833834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 168/313] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:17:55.839295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:55.946342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f555-34ec-4815-a987-9e517e96d5ae None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:55.984926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:55.985541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:55.985823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:55.986135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:55.986799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:55.987104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:55.988482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:55.998040 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 146/314] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:56.003449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:56.111987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a47d14-b4ef-4ac0-84e9-f7f3e57813bb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:56.158729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:56.159359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:56.159635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:56.159900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] PATH_INFO: `/v3/users/4c4e37c29be548acbfa406c53cf02993` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:56.161777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] RBAC: Authorizing `identity:get_user(user_id=4c4e37c29be548acbfa406c53cf02993)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:56.163334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:56.165264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 169/315] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:56 2022] GET /identity/v3/users/4c4e37c29be548acbfa406c53cf02993 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:56.170619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:56.190756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:56.276660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e377-51d5-4758-9924-334d8b8fb943 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:56.315767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:56.317393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:56.317929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:56.318416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:56.390038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:56.391876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:56.411209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:56.504022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 147/316] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:17:56.509850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:56.527244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:56.620841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbcb2e-f870-45a4-956d-47d1310feafb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:56.656334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56353ca1-727c-4b56-8636-b878686bca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:56.656885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56353ca1-727c-4b56-8636-b878686bca3c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:56.657169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56353ca1-727c-4b56-8636-b878686bca3c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:56.657447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56353ca1-727c-4b56-8636-b878686bca3c None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:56.658605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56353ca1-727c-4b56-8636-b878686bca3c None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:56.660046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56353ca1-727c-4b56-8636-b878686bca3c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:56.662563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 170/317] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:17:56 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:56.668405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:56.772860 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55e9ab-0733-40db-a501-18f0a8a78119 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:56.792705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:56.811123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd829e-fddc-4524-a556-507741466404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:56.812059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd829e-fddc-4524-a556-507741466404 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:56.812583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd829e-fddc-4524-a556-507741466404 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:56.813063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd829e-fddc-4524-a556-507741466404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:56.814016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd829e-fddc-4524-a556-507741466404 None admin] RBAC: Adding query filter params (role.id=b2b4db89dc10402c80dbb7a173382ec3, scope.project.id=c35e43fe63da45b880d2d6fee878a32e, user.id=4c4e37c29be548acbfa406c53cf02993) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:56.814525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd829e-fddc-4524-a556-507741466404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:56.816142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd829e-fddc-4524-a556-507741466404 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:56.824855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 148/318] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:17:56 2022] GET /identity/v3/role_assignments?user.id=4c4e37c29be548acbfa406c53cf02993&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=b2b4db89dc10402c80dbb7a173382ec3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:57.066330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5479d-7aa4-416b-a87c-92086567e0f6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.066655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5479d-7aa4-416b-a87c-92086567e0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.067429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5479d-7aa4-416b-a87c-92086567e0f6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.068779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 171/319] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:57.074238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811a5c-b541-4115-a68e-5157230bbbab None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.074532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811a5c-b541-4115-a68e-5157230bbbab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.074813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f811a5c-b541-4115-a68e-5157230bbbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.093822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0f811a5c-b541-4115-a68e-5157230bbbab None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:57.095057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f811a5c-b541-4115-a68e-5157230bbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:57.164231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 149/320] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:57.401152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4914b-5ffc-42b2-b326-6f55c1a6f130 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.401480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4914b-5ffc-42b2-b326-6f55c1a6f130 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.401656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4914b-5ffc-42b2-b326-6f55c1a6f130 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.403120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 172/321] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:57.408367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df73c3-52ac-455d-952f-32c0473df556 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.408819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df73c3-52ac-455d-952f-32c0473df556 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.408957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df73c3-52ac-455d-952f-32c0473df556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.427547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a4df73c3-52ac-455d-952f-32c0473df556 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:57.428722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a4df73c3-52ac-455d-952f-32c0473df556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:57.436830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4914b-5ffc-42b2-b326-6f55c1a6f130 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:57.497730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 150/322] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:17:57.501050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7112b6-9931-4134-be9f-5303778a563a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.501050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7112b6-9931-4134-be9f-5303778a563a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.501050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7112b6-9931-4134-be9f-5303778a563a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.501050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 151/323] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:17:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:17:57.506359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.506809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.507089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.525000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:17:57.525290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:57.526318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:17:57.547706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4914b-5ffc-42b2-b326-6f55c1a6f130 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:57.569179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:57.581972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:57.583060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.583343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.583615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.584787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:57.586383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:57.589894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 173/324] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:57.593242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:57.612258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 152/325] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:17:57.694583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5089-0b08-4bc2-b7f6-22afe3f38845 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:57.729020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:57.729628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.729943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.730220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] PATH_INFO: `/v3/groups` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.730842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:57.732268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:57.771590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:57.817892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 174/326] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Aug 24 09:17:57 2022] POST /identity/v3/groups => generated 226 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:17:57.882818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:57.891838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04165e3-29b1-4e86-8893-467dfdd4a32b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:57.894546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:57.929578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:57.930559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:57.930990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:57.931406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:57.943700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:57.948879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:57.950004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:17:57.951031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:17:57.953022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 153/327] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:57.960039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:57.998323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:57.999939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e8c86-ddc6-4bac-874d-d62d660d7a3f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.039567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.039993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.040277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.040554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.051592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:17:58.057188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:17:58.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:17:58.060438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 175/328] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:17:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:17:58.066061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:58.086456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b6a70-bda6-49a0-bf85-227fa087878b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.135361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.136499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.136785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.137063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.138125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:58.138569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:58.140093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:58.149007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:58.156007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 154/329] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:58.157570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:58.197113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9db187-11fd-49f9-bc01-4c423abc49d9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.243035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.243654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.243933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.244203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.244879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:58.245664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:58.247503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:58.257606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 176/330] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:17:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:58.263143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:58.268259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:58.279855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515539-d9cc-476b-a92f-0a2077f8fcbe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.320014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.320663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.321213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.321494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] PATH_INFO: `/v3/users/fb8d655ac72e48aa834caaf83533dd34` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.322750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] RBAC: Authorizing `identity:get_user(user_id=fb8d655ac72e48aa834caaf83533dd34)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:58.324366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:58.330193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 155/331] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:58 2022] GET /identity/v3/users/fb8d655ac72e48aa834caaf83533dd34 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:58.336757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:58.398111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ece3a-ecf1-44c2-aa68-10aeb1615f4c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.433502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:17:58.442298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.442831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.443121 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.443402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] PATH_INFO: `/v3/users/a54e589666624ddb97e088d8362229dd` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.451364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] RBAC: Authorizing `identity:get_user(user_id=a54e589666624ddb97e088d8362229dd)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:58.451364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:58.451364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 177/332] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:17:58 2022] GET /identity/v3/users/a54e589666624ddb97e088d8362229dd => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:17:58.455606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:17:58.494623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a6059-cdfa-469a-90ad-4fb684a11786 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.534762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.536303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.536763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.537232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.538248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] RBAC: Adding query filter params (role.id=2ffdbc0543fc4f02ae9144d11b210885, user.id=fb8d655ac72e48aa834caaf83533dd34, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:17:58.538751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:58.542548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7703-7d3c-48db-8625-2440ac2a28cb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:58.558352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 156/333] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 24 09:17:58 2022] GET /identity/v3/role_assignments?user.id=fb8d655ac72e48aa834caaf83533dd34&scope.system=all&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:17:58.585805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d360e08-4c14-405d-926d-9bcde3f6ed58 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:17:58.634193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35992b67-00cb-4e9a-96ea-cec03bf02412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:17:58.634947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992b67-00cb-4e9a-96ea-cec03bf02412 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:17:58.635275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992b67-00cb-4e9a-96ea-cec03bf02412 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:17:58.635562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35992b67-00cb-4e9a-96ea-cec03bf02412 None admin] PATH_INFO: `/v3/system/users/a54e589666624ddb97e088d8362229dd/roles/b2b4db89dc10402c80dbb7a173382ec3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:17:58.638752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992b67-00cb-4e9a-96ea-cec03bf02412 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a54e589666624ddb97e088d8362229dd, role_id=b2b4db89dc10402c80dbb7a173382ec3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:17:58.640438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35992b67-00cb-4e9a-96ea-cec03bf02412 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:17:58.709719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 178/334] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Aug 24 09:17:58 2022] PUT /identity/v3/system/users/a54e589666624ddb97e088d8362229dd/roles/b2b4db89dc10402c80dbb7a173382ec3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:00.011090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68addf74-48fe-467a-aab3-6ad2dcb5b74e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:00.012273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68addf74-48fe-467a-aab3-6ad2dcb5b74e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:00.012797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68addf74-48fe-467a-aab3-6ad2dcb5b74e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:00.014693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 157/335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:00.020977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cf0e7-660a-4fce-b60b-ffd6d76bdde0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:00.021932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cf0e7-660a-4fce-b60b-ffd6d76bdde0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:00.022431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cf0e7-660a-4fce-b60b-ffd6d76bdde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:00.047197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-854cf0e7-660a-4fce-b60b-ffd6d76bdde0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:00.048709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-854cf0e7-660a-4fce-b60b-ffd6d76bdde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:00.140522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:00.152830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 179/336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:00.707685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68addf74-48fe-467a-aab3-6ad2dcb5b74e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:00.732388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:00.847505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68addf74-48fe-467a-aab3-6ad2dcb5b74e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:00.921194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dfa25-9947-44df-931a-ebd2d4fc0009 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:00.921515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dfa25-9947-44df-931a-ebd2d4fc0009 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:00.921757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dfa25-9947-44df-931a-ebd2d4fc0009 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:00.923469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 180/337] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:00.928680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268c4d-acfc-4e86-b190-3edd7462ee1d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:00.928970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268c4d-acfc-4e86-b190-3edd7462ee1d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:00.929239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268c4d-acfc-4e86-b190-3edd7462ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:00.955508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e3268c4d-acfc-4e86-b190-3edd7462ee1d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:00.956713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e3268c4d-acfc-4e86-b190-3edd7462ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:01.003094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56316a-6aa6-4b53-ae84-c3f1c851560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:01.003665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56316a-6aa6-4b53-ae84-c3f1c851560a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.003960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56316a-6aa6-4b53-ae84-c3f1c851560a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.004415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56316a-6aa6-4b53-ae84-c3f1c851560a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.029486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56316a-6aa6-4b53-ae84-c3f1c851560a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3d56316a-6aa6-4b53-ae84-c3f1c851560a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:01.034302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:01.035176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:01.036796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 158/338] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:01.037451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1de2c-9f2a-4ec8-9bc4-b665cfe58a64 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.037525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1de2c-9f2a-4ec8-9bc4-b665cfe58a64 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.038155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1de2c-9f2a-4ec8-9bc4-b665cfe58a64 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.040700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 159/339] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:01.052346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1de2c-9f2a-4ec8-9bc4-b665cfe58a64 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.091216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 181/340] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:01.093164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.093655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.094152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.131536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:01.132744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:01.190242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:01.237792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1de2c-9f2a-4ec8-9bc4-b665cfe58a64 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:01.259451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 182/341] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:01.284876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:01.286486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.287063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.287549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.288478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:01.289021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:01.290745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:01.302457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 160/342] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:01.310456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.369210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:01.422114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bbc58-00c8-4a2b-8b1a-20c54b599876 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:01.459903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:01.460875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.461386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.461884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.537502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:01.539356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:01.600608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:01.605875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.655047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 183/343] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:01.659880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.725694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182930-8ae0-4aec-9ab9-279e788eac01 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:01.762973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:01.763616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.763901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.764188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.773061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:01.774845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f8d06-942c-4fb1-a64b-c51bfb525a6a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:01.776895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:01.783816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:01.790713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 161/344] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:01.791937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.819326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:01.820364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.820891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.821422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.835836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:01.842482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:01.843433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:01.844334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:01.846776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 184/345] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:01.848535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.871384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:01.923478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4112574-bf59-40e9-81ea-7f6f654a79f1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:01.962947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88069d88-e133-4d3c-bfe4-617770b0dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:01.963490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88069d88-e133-4d3c-bfe4-617770b0dd48 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.964130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88069d88-e133-4d3c-bfe4-617770b0dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.964130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88069d88-e133-4d3c-bfe4-617770b0dd48 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.967404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88069d88-e133-4d3c-bfe4-617770b0dd48 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:01.967404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88069d88-e133-4d3c-bfe4-617770b0dd48 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:01.968671 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 162/346] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:01.969959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b4fc-6af0-48c8-b02f-59edec4dd0ed None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:01.971068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b4fc-6af0-48c8-b02f-59edec4dd0ed None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:01.971354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b4fc-6af0-48c8-b02f-59edec4dd0ed None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:01.972745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 163/347] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:01.973676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b4fc-6af0-48c8-b02f-59edec4dd0ed None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:01.975626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ae4c-8b1b-48bc-92e3-7390797ec19c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.023868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:02.024480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.024758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.025055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.025723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:02.026246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:02.028085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd23ef-f4a0-4f01-8d4c-d22e9fa3096f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:02.040298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 185/348] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:02.041640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6b15-6881-4ab4-b5d0-19d1ae766aab None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.041903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6b15-6881-4ab4-b5d0-19d1ae766aab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.042185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6b15-6881-4ab4-b5d0-19d1ae766aab None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.043722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 186/349] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:02.045296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.045585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.049798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.068714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.072867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:02.074084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:02.120299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b4fc-6af0-48c8-b02f-59edec4dd0ed None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.161896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 187/350] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:02.161896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:02.164810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.182444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:02.183205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.183781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.184064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.184734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:02.185037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:02.186991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:02.199613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 164/351] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:02.201620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:02.288532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7693dc-642e-4715-b86d-3e370e64af3e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.326799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1600b7-e619-4420-a52b-b8a9a6763542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:02.327422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1600b7-e619-4420-a52b-b8a9a6763542 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.327708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1600b7-e619-4420-a52b-b8a9a6763542 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.328030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1600b7-e619-4420-a52b-b8a9a6763542 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.334545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1600b7-e619-4420-a52b-b8a9a6763542 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:02.336071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1600b7-e619-4420-a52b-b8a9a6763542 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:02.342129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 188/352] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:02 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:02.343432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.343726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.344008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.347231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f84f1-df97-4088-b499-b6c353a407d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.366756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:02.367965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:02.385085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.392785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:02.393617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.393917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.394531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.439157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.448312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 189/353] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:02.449166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:02.493400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:02.494924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:02.574692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f868692-63bc-422a-b9f7-6dac77e5d030 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.618126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 165/354] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:02.619052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:02.623927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:02.624562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.624848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.625128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.662900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.705143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.710623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:02.712129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:02.754932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384855a-0b76-41be-899d-baee3fbe9dc7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.803631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:02.804248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:02.804531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:02.804807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:02.806137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=451e90a11827408c85a7bb4e2f02090f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:02.806137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:02.807500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:02.815925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 166/355] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:02 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:02.817992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:02.846960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 190/356] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:02.848604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:02.958220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.967356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea1ad-26c2-48d5-b22e-1b0d86d35e68 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:02.972218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:02.975395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61296-9487-42c6-a800-aa621e6248eb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.015999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ef384-a6c1-40e0-9461-e13ae313b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.016649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef384-a6c1-40e0-9461-e13ae313b32b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.016933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef384-a6c1-40e0-9461-e13ae313b32b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.017211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ef384-a6c1-40e0-9461-e13ae313b32b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.030761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ef384-a6c1-40e0-9461-e13ae313b32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:03.031600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.032246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.032528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.037881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.037881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-275ef384-a6c1-40e0-9461-e13ae313b32b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:03.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:03.038902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:18:03.039716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:03.040319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.040393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 167/357] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:03.040460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 191/358] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:02 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.040460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.045886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef737-13e8-4947-bc61-9d1eb85831d0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.046156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef737-13e8-4947-bc61-9d1eb85831d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.046315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef737-13e8-4947-bc61-9d1eb85831d0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.049878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 168/359] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:03.049878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef737-13e8-4947-bc61-9d1eb85831d0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.197088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef737-13e8-4947-bc61-9d1eb85831d0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.213346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa75eac-f880-4a78-8b36-9e0ba8dcf711 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.252734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.253372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.253652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.256834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.258966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.258966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.263628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 169/360] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.265349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.282216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.282216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.282216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.282552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.303725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:03.306782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:03.307669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:03.308459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 192/361] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:03.311608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.319015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:03.352645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:03.451081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1554acc-bbcc-4694-ba0e-30885587f978 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.487382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3c89f-9967-48f0-8796-fae5f04789d7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.501388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230778-ac0a-4445-b44a-72ec4b3c6594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.502254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230778-ac0a-4445-b44a-72ec4b3c6594 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.502429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230778-ac0a-4445-b44a-72ec4b3c6594 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.506608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230778-ac0a-4445-b44a-72ec4b3c6594 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.508409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b230778-ac0a-4445-b44a-72ec4b3c6594 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.510029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b230778-ac0a-4445-b44a-72ec4b3c6594 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.511813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 193/362] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.512877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.513166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.513550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.534304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.534535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:03.534911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.535853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.536277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.536387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:03.537059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:03.537367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.538785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.548446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 170/363] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.549297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.622053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 194/364] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:03.626101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.654637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:03.661618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:03.678494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2bbf-8b9b-4b19-b428-789c8c710c9f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.722164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.723509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.723955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.724269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.725570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.727234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.729238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 171/365] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.734805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.759548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb64fe-d71e-4a82-9d0e-84a5e3b1ea47 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.806812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.808061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.808983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.809702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.810589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:03.811087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.813586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.824834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 195/366] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.826571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.865712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9f40b-bec0-4ee9-9b4b-7c89b55a9888 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:03.905094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:03.905705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:03.906764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:03.907050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:03.907784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=451e90a11827408c85a7bb4e2f02090f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:03.908098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:03.910641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:03.924045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 172/367] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=402534b8089045d3acf4ac1379844e80 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:03.924373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:03.949299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:03.959477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:03.976443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b074b-021a-4278-8fad-a57eff036119 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.034446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.037011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.037522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.038037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] PATH_INFO: `/v3/users/a54e589666624ddb97e088d8362229dd` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.042587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] RBAC: Authorizing `identity:get_user(user_id=a54e589666624ddb97e088d8362229dd)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:04.044054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:04.045888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 196/368] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/users/a54e589666624ddb97e088d8362229dd => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:04.046573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.084059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd883-ea15-43cd-a167-9a290cbfb0dd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.130066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.130962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.131142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.131420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.132161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=c35e43fe63da45b880d2d6fee878a32e) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:04.132522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:04.133929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:04.144122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 173/369] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:03 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:04.145176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.198580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a7394-bec1-4935-8518-96df4fa6cb93 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.239489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.240930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.241436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.241946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.290340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:04.322102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:04.323746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:04.360865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:04.406195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e188a8-ccd0-47c7-984e-f49a16b04b7f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.440910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 197/370] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:04.443000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.452563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.453207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.453597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.453894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.466292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:04.474995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:04.475908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:04.476698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 174/371] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:04.477342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.504135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:04.553612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f66f49-a5e9-4445-9845-d905847f5124 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.591146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.591766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.592051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.592332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.593068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] RBAC: Adding query filter params (role.id=b2b4db89dc10402c80dbb7a173382ec3, user.id=a54e589666624ddb97e088d8362229dd, scope.system=all) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:04.593381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:04.595167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:04.609284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 198/372] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/role_assignments?user.id=a54e589666624ddb97e088d8362229dd&scope.system=all&role.id=b2b4db89dc10402c80dbb7a173382ec3 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:04.610341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.728470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc898da-8ac0-49c8-9e0e-fd6d79703186 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.731847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90c1b2-5b36-43d4-aff4-ca326b6d5930 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.751306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:04.766929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.767647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.768610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.768610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.769021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:04.770101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:04.771660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:04.782178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 199/373] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:04.791068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.810343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.810959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.811247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.811524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:04.814532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:04.816134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:04.821356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 175/374] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:04.828988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:04.850845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:04.950889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb6ea-1f10-480c-b878-eaf21491584f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:04.996828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:04.997452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:04.997756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:04.998199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.066130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:05.095457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:05.096946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:05.119860 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6018-c05d-4497-8175-ceebdcab4e2e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:05.193054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:05.193745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.194061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.194342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.198596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:05.200133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:05.202079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 176/375] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:05.208778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:05.219631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 200/376] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:05.227076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:05.323879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:05.329406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:05.349451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6186b-81b2-4cca-95ef-139e7c0fe36a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:05.368250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5565f7-2921-4a40-a215-75c18ea89cb9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:05.385478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2ee30-dda5-4b36-a138-b4181b8387a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:05.386235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ee30-dda5-4b36-a138-b4181b8387a5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.386605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ee30-dda5-4b36-a138-b4181b8387a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.386956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ee30-dda5-4b36-a138-b4181b8387a5 None admin] PATH_INFO: `/v3/projects/808b3dabc5b4438aaacc878cdfe73e11` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.388164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2ee30-dda5-4b36-a138-b4181b8387a5 None admin] RBAC: Authorizing `identity:get_project(project_id=808b3dabc5b4438aaacc878cdfe73e11)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:05.389707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2ee30-dda5-4b36-a138-b4181b8387a5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:05.391773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 201/377] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:05 2022] GET /identity/v3/projects/808b3dabc5b4438aaacc878cdfe73e11 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:05.396042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327f11c-daad-4c83-8ca3-6cc8bb6dc7cd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.396042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327f11c-daad-4c83-8ca3-6cc8bb6dc7cd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.396042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327f11c-daad-4c83-8ca3-6cc8bb6dc7cd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.396289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 202/378] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:05.406339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.406724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.407072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.424566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:05.426589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.427280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.427865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.428789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=c35e43fe63da45b880d2d6fee878a32e) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:05.429278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:05.431178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:05.431492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:05.432817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:05.440350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 177/379] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:05 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=402534b8089045d3acf4ac1379844e80 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:05.441681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:05.571462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 203/380] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:05.599534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd73f4-af71-46ab-9feb-3a57ad14fbfe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:05.642401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:05.643449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.643950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.644455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] PATH_INFO: `/v3/groups/60b9df3dd89448fc86738f6959ca6728` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.651480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] RBAC: Authorizing `identity:get_group(group_id=60b9df3dd89448fc86738f6959ca6728)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:05.653234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:05.655390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 178/381] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:05 2022] GET /identity/v3/groups/60b9df3dd89448fc86738f6959ca6728 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:05.661431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:05.767272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:05.804072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a726900-d533-4fc3-94af-425a4f06ee5d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:05.855239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:05.855789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:05.856072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:05.856352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:05.857095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] RBAC: Adding query filter params (group.id=60b9df3dd89448fc86738f6959ca6728, role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=808b3dabc5b4438aaacc878cdfe73e11) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:05.857410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:05.858953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f2f2-95cf-4130-b7ec-7b73d95e53a2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:05.865646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 204/382] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:05 2022] GET /identity/v3/role_assignments?group.id=60b9df3dd89448fc86738f6959ca6728&scope.project.id=808b3dabc5b4438aaacc878cdfe73e11&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:06.067965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:06.072494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:06.195874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976bb39-1ef2-4f14-8918-078374147dcc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:06.238816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:06.239832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.240314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.240808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.254686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2727759-14ac-4802-a379-851ff5796356 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.255042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2727759-14ac-4802-a379-851ff5796356 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.255329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2727759-14ac-4802-a379-851ff5796356 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.256833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 205/383] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:06.258724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:06.262345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.262862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.263330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:06.264062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:06.264931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:06.266884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 179/384] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:06.272529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:06.289558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:06.291139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:06.366108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:06.402975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be537a8e-71b2-4f51-9955-96593ec5f188 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:06.433881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 206/385] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:06.444913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:06.445783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.446357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.446835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.447703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:06.448203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:06.449781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:06.463996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 180/386] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:06.469379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:06.576126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:06.615144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d660cc-bef4-486f-aa13-fefe61cbdbd3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:06.663990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:06.664641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.664924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.665199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.666436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:06.667884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:06.669896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 207/387] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:06 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:06.675472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:06.754432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:06.824783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb258cf5-eb21-4a6e-bfc2-1360218ef08c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:06.894200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:06.908276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:06.909675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.909788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f75bb-0692-4723-9f1e-6a1fa69b5787 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:06.911178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.911467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.913382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:06.914862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:06.921264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 181/388] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:06 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:06.928393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:06.976385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:06.977027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:06.977310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:06.977588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:06.982694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:07.002348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:07.011208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:07.012128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:07.012951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:07.016323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 208/389] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:07.019054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:07.112921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adcaff-44f2-4ff7-948e-a56e8a5f86e8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:07.180561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00625b70-41d1-4dc0-a701-006477c3393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:07.182060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625b70-41d1-4dc0-a701-006477c3393e None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.182545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625b70-41d1-4dc0-a701-006477c3393e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.182823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00625b70-41d1-4dc0-a701-006477c3393e None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.188094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00625b70-41d1-4dc0-a701-006477c3393e None admin] RBAC: Authorizing `identity:create_grant(project_id=451e90a11827408c85a7bb4e2f02090f, group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:07.189540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00625b70-41d1-4dc0-a701-006477c3393e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:07.209228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49818e54-1845-4166-ab81-db3ffc11c33f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:07.246065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:07.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.249587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.249587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.249587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:07.249587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:07.250115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd475719-a399-4f44-b101-886eb07b623d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:07.258663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 209/390] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:07.259753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c951-fd79-4a33-bcb2-5746a80578a5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.260045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c951-fd79-4a33-bcb2-5746a80578a5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.260361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c951-fd79-4a33-bcb2-5746a80578a5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.261821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 210/391] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:07.264099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318c951-fd79-4a33-bcb2-5746a80578a5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:07.277203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 182/392] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 24 09:18:06 2022] PUT /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:18:07.278831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.282080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.282080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.303860 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:07.305390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:07.345041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:07.414403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:07.438143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318c951-fd79-4a33-bcb2-5746a80578a5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:07.446540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 183/393] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:07.483300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:07.484315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.484801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.485405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.486752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:07.489379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:07.491542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 211/394] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:07 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:07.499218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:07.606369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3019cd-d25a-430f-b17a-8ae2850ed8ec None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:07.649408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:07.650423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.650916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.651390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.654662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:07.656365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:07.658648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 184/395] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:07 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:07.664653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:07.756477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:07.822293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:07.826890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5900dc1-c81c-49cd-bc06-5c3854541342 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:07.862220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:07.875705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73669c-538e-4e04-8041-cac61aa9a9b3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:07.875989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6d8ab-8bf0-401c-9ae5-a5de83167659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:07.876603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d8ab-8bf0-401c-9ae5-a5de83167659 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.876884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d8ab-8bf0-401c-9ae5-a5de83167659 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.877334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6d8ab-8bf0-401c-9ae5-a5de83167659 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.884461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6d8ab-8bf0-401c-9ae5-a5de83167659 None admin] RBAC: Authorizing `identity:create_grant(project_id=451e90a11827408c85a7bb4e2f02090f, group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:07.886068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6d8ab-8bf0-401c-9ae5-a5de83167659 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:07.916709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a5313-0d8d-4441-8018-59583bbb169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:07.917475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5313-0d8d-4441-8018-59583bbb169c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.917829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5313-0d8d-4441-8018-59583bbb169c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.918203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5313-0d8d-4441-8018-59583bbb169c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.929666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5313-0d8d-4441-8018-59583bbb169c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-904a5313-0d8d-4441-8018-59583bbb169c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:07.934908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:07.938369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 185/396] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:07.939588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c2c9-04f8-40e7-8979-4f3d5f102b96 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.940325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c2c9-04f8-40e7-8979-4f3d5f102b96 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.940325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c2c9-04f8-40e7-8979-4f3d5f102b96 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:07.943817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 186/397] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:07.944958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c2c9-04f8-40e7-8979-4f3d5f102b96 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:07.964384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 212/398] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 24 09:18:07 2022] PUT /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/402534b8089045d3acf4ac1379844e80 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:07.974031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:07.974374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:07.974591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.015448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:08.018962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:08.152528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 213/399] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:08.158223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c2c9-04f8-40e7-8979-4f3d5f102b96 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:08.179775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:08.205579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:08.206231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.206571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.207022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.207829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:08.208142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:08.209643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3dcd5-f72b-44fc-aa91-73fcd08c4a51 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:08.219241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 187/400] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:08.225026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:08.381684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692c104-6888-42d9-bd41-1bca512735e5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:08.394449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0855-c1df-45be-a5c0-bfaf1ca43f23 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.394779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0855-c1df-45be-a5c0-bfaf1ca43f23 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.395147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0855-c1df-45be-a5c0-bfaf1ca43f23 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.396766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 188/401] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:08.400893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:08.403108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.403614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.404093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.429727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:08.432049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:08.435499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:08.436179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.436463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.436738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.442579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:08.444039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:08.445965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 214/402] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:08 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:08.451214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:08.515768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 189/403] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:08.591069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267cf25-e07e-4e2e-805c-bd65709eebba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:08.613649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:08.647190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:08.647841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.648128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.648404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.650044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:08.651488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:08.660989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 215/404] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:08 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:08.660989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:08.729165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:08.800680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363f4b3-acca-452a-9fc6-b01f2c20519f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:08.839975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb3d9-6d9e-4ecf-ac04-9d1e5a4f3acb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:08.843364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:08.845046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:08.845714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.846039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.846315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.848814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35e43fe63da45b880d2d6fee878a32e, group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:08.850827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:08.876902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:08.877610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:08.878046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:08.878383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:08.889618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:08.895088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:08.896100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:08.897092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 190/405] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:08.898006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:08.963996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 216/406] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 24 09:18:08 2022] PUT /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:18:08.963996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.072947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389f4cc-ca88-428f-92c7-4cc055342a17 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.143644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.145320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.145814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.146830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.158694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50989a-ac36-4894-a1df-018d28a28672 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.162923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:09.169600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:09.170548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:09.171327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 191/407] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:09.177387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:09.179554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.208000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:09.212046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.212927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.213412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.213977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.215446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:09.216190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.218462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.228766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 217/408] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:09.237025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.306647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99645d2-ed41-43d0-acc9-22753dcc9015 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.344170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.344778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.345334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.345334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.346029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:09.346337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.348301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.358462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 192/409] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:09.364541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.376774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbcfb2-06f7-4aec-8c9e-3019f6279fa9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.420605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.421618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.422222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.422744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.424067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.426330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.428423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 218/410] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:09 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:09.433959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.457997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:09.474069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93258b68-9102-449c-bbbb-c65d42806294 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.479113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:09.516022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.516662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.516951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.517233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] PATH_INFO: `/v3/groups/60b9df3dd89448fc86738f6959ca6728` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.519521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] RBAC: Authorizing `identity:get_group(group_id=60b9df3dd89448fc86738f6959ca6728)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.522352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.523975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 193/411] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:09 2022] GET /identity/v3/groups/60b9df3dd89448fc86738f6959ca6728 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:09.531960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.600110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851ebec-43e2-4fa3-a656-d7f15de5be12 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.668916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b10af-d4a2-48d3-bc67-515227734c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.669559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b10af-d4a2-48d3-bc67-515227734c61 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.669842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b10af-d4a2-48d3-bc67-515227734c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.670146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b10af-d4a2-48d3-bc67-515227734c61 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.671288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b10af-d4a2-48d3-bc67-515227734c61 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.672729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b10af-d4a2-48d3-bc67-515227734c61 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.674704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 219/412] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:09 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:09.679500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ec6b-da38-457f-b972-92137c425dbd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.679793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ec6b-da38-457f-b972-92137c425dbd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.680081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ec6b-da38-457f-b972-92137c425dbd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.682572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 220/413] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:09.683289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ec6b-da38-457f-b972-92137c425dbd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.714063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4e2b4-e6fd-451f-9d73-7ba71c39e99b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.752362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44c3d9-9b28-4094-be28-601f7e48ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.752702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c3d9-9b28-4094-be28-601f7e48ada2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.752993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c3d9-9b28-4094-be28-601f7e48ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.753270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c3d9-9b28-4094-be28-601f7e48ada2 None admin] PATH_INFO: `/v3/projects/808b3dabc5b4438aaacc878cdfe73e11` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.754589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44c3d9-9b28-4094-be28-601f7e48ada2 None admin] RBAC: Authorizing `identity:get_project(project_id=808b3dabc5b4438aaacc878cdfe73e11)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.756343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44c3d9-9b28-4094-be28-601f7e48ada2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.758243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 194/414] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:09 2022] GET /identity/v3/projects/808b3dabc5b4438aaacc878cdfe73e11 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:09.759740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.759996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.760277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.778811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:09.780003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:09.798945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:09.803788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ec6b-da38-457f-b972-92137c425dbd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.813731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:09.848828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:09.849958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:09.850383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:09.850817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:09.853168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35e43fe63da45b880d2d6fee878a32e, group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:09.855104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:09.861233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 195/415] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:09.865628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:09.971237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56497ea-cdd4-4863-b937-e12310d44931 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:09.982485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 221/416] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 24 09:18:09 2022] PUT /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2/roles/402534b8089045d3acf4ac1379844e80 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:10.034662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181a497-340f-4dfa-a279-26353b07a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:10.035514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a497-340f-4dfa-a279-26353b07a0d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.035794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a497-340f-4dfa-a279-26353b07a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.036074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a497-340f-4dfa-a279-26353b07a0d4 None admin] PATH_INFO: `/v3/projects/808b3dabc5b4438aaacc878cdfe73e11/groups/60b9df3dd89448fc86738f6959ca6728/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.041033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181a497-340f-4dfa-a279-26353b07a0d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=808b3dabc5b4438aaacc878cdfe73e11, group_id=60b9df3dd89448fc86738f6959ca6728, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:10.042597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181a497-340f-4dfa-a279-26353b07a0d4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:10.122975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 196/417] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 24 09:18:09 2022] PUT /identity/v3/projects/808b3dabc5b4438aaacc878cdfe73e11/groups/60b9df3dd89448fc86738f6959ca6728/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:10.176029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:10.256260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334768b-4616-4d97-8fe5-a52d38ed5fe3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.256584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334768b-4616-4d97-8fe5-a52d38ed5fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.256826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334768b-4616-4d97-8fe5-a52d38ed5fe3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.258289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 197/418] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:10.264002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.264285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.264554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.301606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fb79f-a4da-4dda-a346-919d85ed2c45 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:10.306696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:10.307897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:10.321185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:10.348530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:10.348530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.348894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.348894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.365697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:10.370903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:10.371838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:10.372643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:10.374984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 222/419] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:10.384196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:10.412500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 198/420] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:10.425184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:10.523301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a9512-3548-48d4-8099-091a5800661d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:10.564689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:10.565222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.565502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.565775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.566664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:10.566973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:10.568416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:10.581349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 223/421] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:10.587189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:10.734601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31ef10-f2cf-4327-acd6-2746890a0934 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:10.769701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:10.793019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:10.793639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.793946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.794223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.815708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:10.882254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:10.890411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560274-dcc4-41fa-b2b4-bcffb33cf4a9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:10.930996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:10.932451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:10.932971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:10.933452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:10.946394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:10.952167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:10.953048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:10.953829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:10.956834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 224/422] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:10.963116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.038662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.040149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.075326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330d79f-a865-43ff-b188-63ed868dd3ca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.121322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:11.122328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.122876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.123390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.124259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:11.124779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.126418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.135902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 225/423] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:11.141591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.174217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:11.260572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 199/424] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:11.266219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.299931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173092f-8015-4cf1-9abf-f0605e8492bd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.337196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:11.358543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd170f3-ea06-48ca-b0f6-f9e78ea0b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:11.359152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd170f3-ea06-48ca-b0f6-f9e78ea0b2ff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.359436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd170f3-ea06-48ca-b0f6-f9e78ea0b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.359699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd170f3-ea06-48ca-b0f6-f9e78ea0b2ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.404661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3371059-0f45-4b9a-8d06-e9fae5d790ca None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.442899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d9316-10c9-4d5f-8485-901c0227b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:11.443916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9316-10c9-4d5f-8485-901c0227b97d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.444401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9316-10c9-4d5f-8485-901c0227b97d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.444886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9316-10c9-4d5f-8485-901c0227b97d None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.446267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d9316-10c9-4d5f-8485-901c0227b97d None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.447912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d9316-10c9-4d5f-8485-901c0227b97d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.450186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 200/425] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:11 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:11.451587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567700ba-0f18-47a0-a331-e490ecb91746 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.452090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567700ba-0f18-47a0-a331-e490ecb91746 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.452263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd170f3-ea06-48ca-b0f6-f9e78ea0b2ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.452731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567700ba-0f18-47a0-a331-e490ecb91746 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.453743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd170f3-ea06-48ca-b0f6-f9e78ea0b2ff None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.459713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 201/426] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:11.460946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567700ba-0f18-47a0-a331-e490ecb91746 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.469800 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:11.576466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567700ba-0f18-47a0-a331-e490ecb91746 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.589125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 226/427] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:18:11.590911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:11.591316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.591316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.591477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.616259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:11.617455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:11.621915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:11.622771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.623264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.623675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.624938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.627124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.630453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 202/428] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:11 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:11.631692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.695404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 227/429] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:11.702653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.762384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7a04b-4dd2-41f6-bcf5-59edf077ea05 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.791051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:11.804419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:11.805307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.805724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.806187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] PATH_INFO: `/v3/projects/451e90a11827408c85a7bb4e2f02090f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.807839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] RBAC: Authorizing `identity:get_project(project_id=451e90a11827408c85a7bb4e2f02090f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.809425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.811740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 203/430] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:11 2022] GET /identity/v3/projects/451e90a11827408c85a7bb4e2f02090f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:11.823361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:11.885338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:11.948855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5f30-9317-498a-a374-ea01afec9065 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.955202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244b5a-279d-497e-b213-26b75c81c821 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:11.990095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:11.991463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:11.992052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:11.992476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:11.993745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:11.995339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:11.997796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 204/431] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:11 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:12.003676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.054822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:12.055456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.055740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.056019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.056756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=451e90a11827408c85a7bb4e2f02090f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:12.057071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:12.058772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:12.073478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 228/432] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:11 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 611 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:12.120402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e13bde-513d-42b2-849d-5af2557f611e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:12.122196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.141351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:12.179868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:12.180885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.181178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.181457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.186105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=451e90a11827408c85a7bb4e2f02090f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:12.186438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:12.187989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acee4f-873e-4929-b09e-53f5d10d0ada None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:12.201424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 205/433] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=451e90a11827408c85a7bb4e2f02090f&role.id=402534b8089045d3acf4ac1379844e80 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:12.262670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f102cf-02a4-4823-a27c-58dccf58d99c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.262956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f102cf-02a4-4823-a27c-58dccf58d99c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.263236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f102cf-02a4-4823-a27c-58dccf58d99c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.264846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 206/434] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:12.273643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.273976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.274237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.277396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652abe6-d23b-4e9d-b676-ce41567f336d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:12.286930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:12.300090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:12.302315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:12.328050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:12.328708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.328989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.329265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.343942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:12.349744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:12.350710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:12.351581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 229/435] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:12.358758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.405122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 207/436] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:12.482050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630437-582d-4c6f-945b-7cb44ae514b4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:12.520419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:12.521038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.521360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.521602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.522315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:12.522622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:12.523990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4219-8286-4696-98b3-021a59529331 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:12.533067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 230/437] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:12.538706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.568745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e234-2cfd-46eb-a0ea-c3688493328c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.569071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e234-2cfd-46eb-a0ea-c3688493328c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.569304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e234-2cfd-46eb-a0ea-c3688493328c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.570956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 231/438] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:12.577123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.577518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.577793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.598387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:12.599594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:12.626358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:12.678243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aebec-ff5f-4af0-9d0f-94e0f757a8c4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:12.686860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 232/439] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:12.689312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:12.707076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.716198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:12.716926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.717227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.717483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.811131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:12.812134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:12.836713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae76e8-8816-4645-b56e-673dbd541fb4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:12.890747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:12.891394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:12.891675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:12.891953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:12.908025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:12.915392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:12.916311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:12.917335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 233/440] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:12.922888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.939801 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 208/441] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:12.945722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:12.948474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:12.958266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.042891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a556-f8c4-455c-a83f-8057134bfb68 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.060174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7c1c-2009-485e-9e76-b6cfd6b49a5d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.076349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.076948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.077224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.077490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.078172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:13.078473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.080084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.088887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 234/442] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:13.090003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.095320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.095951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.096235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.096509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.098248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.099668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.101698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 209/443] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:12 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:13.102818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.169204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.180134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.187589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4b8b-54cb-4898-9175-b2cdaf162c5f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.202413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a418bd3-a6b0-4621-a00c-2a0d3ab7e4e8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.224407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.225032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.225317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.225594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.235360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:13.237304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.238156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.238447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.238719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:13.240478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:13.241349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:13.242183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 235/444] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:13.242832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.309060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.310525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.340241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03df33-3eb4-43fb-8642-04b3c4dd5a97 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.374492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.375114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.375393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.375668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.376784 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.378254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.379879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 236/445] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:13.380636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.386959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.391572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.411190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 210/446] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:13.412071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.480280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b66f5-21c9-451d-8d2c-dab99607ea3b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.511163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad595c0a-5aa1-4a0a-a150-7d356cf24247 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.513301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.513935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.514217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.514490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.515151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:13.515455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.516807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.525324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 237/447] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:13.526781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.546203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.546802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.547082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.547354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.548071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=2ffdbc0543fc4f02ae9144d11b210885, scope.project.id=c35e43fe63da45b880d2d6fee878a32e) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:13.548379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.549793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.556163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 211/448] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=2ffdbc0543fc4f02ae9144d11b210885 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:13.556940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.604912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.606762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.639500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae034780-f0b4-43f7-93de-7b18c9ef8011 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.672474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120061c-f151-4c0d-9957-32b491bde5f9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.678399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.679042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.679321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.679594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] PATH_INFO: `/v3/projects/c35e43fe63da45b880d2d6fee878a32e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.681254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] RBAC: Authorizing `identity:get_project(project_id=c35e43fe63da45b880d2d6fee878a32e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.683155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.685364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 238/449] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/projects/c35e43fe63da45b880d2d6fee878a32e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:13.691385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.712259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.712869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.713150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.713420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.804048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.804048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.808637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf73de-3d38-4eb6-b5b8-26442c90210f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:13.848843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.858710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:13.859364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:13.859749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:13.859915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] PATH_INFO: `/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:13.861031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] RBAC: Authorizing `identity:get_group(group_id=dc0fe7bb231143f9a83aaa5fc5ccf4b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:13.863651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:13.865731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 239/450] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/groups/dc0fe7bb231143f9a83aaa5fc5ccf4b2 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:13.870878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.881126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:13.919708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 212/451] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:13.926344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:13.980242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b313-b8d1-406e-a1a0-907afab26ce8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:14.013915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:14.014514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:14.014806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:14.015079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:14.015807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] RBAC: Adding query filter params (group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2, role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=c35e43fe63da45b880d2d6fee878a32e) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:14.016119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:14.017546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:14.023172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 240/452] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/role_assignments?group.id=dc0fe7bb231143f9a83aaa5fc5ccf4b2&scope.project.id=c35e43fe63da45b880d2d6fee878a32e&role.id=402534b8089045d3acf4ac1379844e80 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:14.029933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9bd68-5598-479b-a8f0-1eae210c5db4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:14.067368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:14.067925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:14.068205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:14.068476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] PATH_INFO: `/v3/projects/808b3dabc5b4438aaacc878cdfe73e11` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:14.069705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=808b3dabc5b4438aaacc878cdfe73e11)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:14.071223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:14.072943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 213/453] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:18:13 2022] GET /identity/v3/projects/808b3dabc5b4438aaacc878cdfe73e11 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:14.078906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:14.152938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:14.184712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6184788-c08a-4db1-8883-714ec09c983a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:14.221047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c7c24-ec2b-4a23-9132-b95ebf3d2378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:14.221742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7c24-ec2b-4a23-9132-b95ebf3d2378 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:14.222095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7c24-ec2b-4a23-9132-b95ebf3d2378 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:14.222371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7c24-ec2b-4a23-9132-b95ebf3d2378 None admin] PATH_INFO: `/v3/groups/60b9df3dd89448fc86738f6959ca6728` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:14.223503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c7c24-ec2b-4a23-9132-b95ebf3d2378 None admin] RBAC: Authorizing `identity:get_group(group_id=60b9df3dd89448fc86738f6959ca6728)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:14.224921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c7c24-ec2b-4a23-9132-b95ebf3d2378 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:14.226551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 241/454] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 24 09:18:14 2022] GET /identity/v3/groups/60b9df3dd89448fc86738f6959ca6728 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:14.232406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:14.246055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:14.343655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ce75-94e4-4b5a-9a19-18508e553ce1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:14.376612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:14.377214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:14.377497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:14.377769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:14.379156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] RBAC: Adding query filter params (group.id=60b9df3dd89448fc86738f6959ca6728, role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=808b3dabc5b4438aaacc878cdfe73e11) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:14.379464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:14.380884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94cb1f-1014-44c8-98b3-1188f646babf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:14.386456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 214/455] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 24 09:18:14 2022] GET /identity/v3/role_assignments?group.id=60b9df3dd89448fc86738f6959ca6728&scope.project.id=808b3dabc5b4438aaacc878cdfe73e11&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:16.684111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4ba84-be57-4660-a405-fe41ce6f5eff None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:16.684967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4ba84-be57-4660-a405-fe41ce6f5eff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:16.685416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4ba84-be57-4660-a405-fe41ce6f5eff None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:16.687184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 242/456] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:16.693600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162eb4b9-03b4-4406-8be1-18ae67f9133e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:16.694382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162eb4b9-03b4-4406-8be1-18ae67f9133e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:16.694803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162eb4b9-03b4-4406-8be1-18ae67f9133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:16.723003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-162eb4b9-03b4-4406-8be1-18ae67f9133e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:16.724434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-162eb4b9-03b4-4406-8be1-18ae67f9133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:16.810126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 215/457] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:17.028917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38c98-2e77-4e12-a31d-438336ab8f12 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.029528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38c98-2e77-4e12-a31d-438336ab8f12 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.030210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38c98-2e77-4e12-a31d-438336ab8f12 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.032177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 243/458] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:17.042120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.042120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.042120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.050417 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:17.062871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:17.064234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:17.155807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 216/459] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:17.212487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e7aaf-d1dd-444a-bcff-4e3baaa551fb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.213032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e7aaf-d1dd-444a-bcff-4e3baaa551fb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.213499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e7aaf-d1dd-444a-bcff-4e3baaa551fb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.215223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 244/460] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:17.219074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:17.236753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.237305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.238067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.270913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:17.272392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:17.337808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606491-6ec6-4923-bdc0-ae9a8c3cf276 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:17.375342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:17.383276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:17.389592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.389592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.389592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.403484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:17.409183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:17.436753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:17.437939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:17.438988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:17.438988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:17.438988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:17.441093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 217/461] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:17.444448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 245/462] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:17.451044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:17.535710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:17.567715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26247b6e-af6a-4e09-93c1-b091210ce31c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:17.607002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:17.607853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.608287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.608699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.609568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:17.610061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:17.611610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:17.624848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 218/463] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:17.632209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:17.699911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:17.722818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:17.745234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170d39-046f-4084-ab8b-1b7e8ee24265 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:17.790884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:17.791898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.792382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.792858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.793478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf33ba-2802-4661-a6bc-4b4af9ab244a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:17.806937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:17.808872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-78a66b62-899c-45ae-b10f-4941e498ed9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:17.834954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:17.836592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:17.837430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:17.837430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:17.837430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:17.837430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 246/464] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:17.837639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9dc8f-a6ac-458d-865f-698e310960e5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.838370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9dc8f-a6ac-458d-865f-698e310960e5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.838531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9dc8f-a6ac-458d-865f-698e310960e5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.839739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 247/465] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:17.840594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9dc8f-a6ac-458d-865f-698e310960e5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:17.843768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:17.844394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:17.844677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:17.844980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:17.845888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:17.848677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:17.959772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 219/466] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:18:17 2022] POST /identity/v3/users => generated 246 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:17.961633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:17.964181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9dc8f-a6ac-458d-865f-698e310960e5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.013908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:18.042301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.043941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.044417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.044996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.061505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.063062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1ec96afa-4b0c-4eb5-a608-9b19e23d2981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:18.087881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:18.088861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:18.089693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:18.089693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:18.089693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:18.093096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 248/467] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:18.094826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.095335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.096147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.102250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:18.105721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe744c19-981d-43e9-bfd0-738991630ae9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.123584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:18.124790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:18.152404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.153025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.153320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.153585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.154748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:18.154748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.156000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.169150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 220/468] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:18.169675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:18.208670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 249/469] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:18.209961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:18.322667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b7b4-81b2-4853-8f52-0fa13e802c7a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.338041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b4898-1a52-4bd1-b50d-869ef1800300 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.340093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:18.368293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.369299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.369775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.370289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.371178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:18.371673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.373357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde93a-1cfd-45f0-a27f-59256305d18f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.380791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670518b-1385-49ac-acf5-76d294bb9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.381401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670518b-1385-49ac-acf5-76d294bb9602 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.381770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670518b-1385-49ac-acf5-76d294bb9602 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.382672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670518b-1385-49ac-acf5-76d294bb9602 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.383333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670518b-1385-49ac-acf5-76d294bb9602 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.385338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670518b-1385-49ac-acf5-76d294bb9602 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.388140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 221/470] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:18.389566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699d0d2-73a4-41bb-9731-f25e27897a04 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.390129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699d0d2-73a4-41bb-9731-f25e27897a04 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.390618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699d0d2-73a4-41bb-9731-f25e27897a04 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.396836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 222/471] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:18.398666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699d0d2-73a4-41bb-9731-f25e27897a04 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:18.431062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:18.479855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 250/472] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:18:18 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:18.482178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.482581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.483019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.508766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:18.511339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:18.532787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699d0d2-73a4-41bb-9731-f25e27897a04 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.586884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.587846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.588325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.588730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.589489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.592038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.599517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 251/473] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:18.607392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:18.688946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 223/474] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:18:18 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:18.726980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:18.743572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c59af-d50f-497b-a869-18694d7c0016 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.782436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.783352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.783804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.784965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.796970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.798714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:18.815841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:18.816967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:18.818014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:18.818014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:18.818014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:18.819815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 252/475] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:18.826448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:18.921291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:18.924538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:18.945782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a76eb-f424-4ecb-aceb-ee863f01aeae None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:18.982650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:18.983495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:18.983607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:18.983871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:18.984531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:18.984928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:18.986244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:18.999461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 224/476] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:19.007832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:19.064300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b35d9-0c48-4774-b210-40941e22c02a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:19.100826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:19.101736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:19.102265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:19.102738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:19.103634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:19.105199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:19.117649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bafda-49c2-4cd1-a6f5-6eff114028d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:19.152603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:19.153217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:19.153491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:19.153760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:19.154430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:19.156014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:19.156613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.sql.core [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:18:19.156613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 09:18:19.156613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [parameters: {'id': '57981ecd303846d58310dd2424f5cd34', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 09:18:19.156613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81583) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:18:19.170246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 24 09:18:19.181290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:18:19.182222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application yield resource Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise self.value Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application session.commit() Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:18:19.183116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:18:19.183959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:18:19.184836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:18:19.186781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [parameters: {'id': '57981ecd303846d58310dd2424f5cd34', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:19.188793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 09:18:19.191404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:19.207412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 253/477] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 24 09:18:18 2022] POST /identity/v3/roles => generated 144 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:19.207412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:19.207412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:19.285334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 225/478] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:18:19 2022] POST /identity/v3/users => generated 249 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:19.317094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa74a-5fad-426f-a48b-7c5fbfb43050 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:19.357186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590db4e-0b08-4322-8072-f7dabc337020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:19.358299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590db4e-0b08-4322-8072-f7dabc337020 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:19.359042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590db4e-0b08-4322-8072-f7dabc337020 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:19.359518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590db4e-0b08-4322-8072-f7dabc337020 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:19.371449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590db4e-0b08-4322-8072-f7dabc337020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e590db4e-0b08-4322-8072-f7dabc337020 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:19.376960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:19.378007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:18:19.379349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:19.382149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 254/479] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:19.388122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:19.515741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295db707-4d2c-4f06-9de1-b56a43226e5c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:19.552894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:19.553915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:19.554447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:19.554939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:19.555807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:19.556312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:19.557923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525af20-c446-4448-a768-c1fb946e83b2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:19.567340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 226/480] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:20.125715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c970c-a7af-451c-804c-8ffa86f55606 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:20.126225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c970c-a7af-451c-804c-8ffa86f55606 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:20.126225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c970c-a7af-451c-804c-8ffa86f55606 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:20.129184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 255/481] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:20.134798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:20.135212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:20.135383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:20.161511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:20.163484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:20.220977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:20.245972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 227/482] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:20.552427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c970c-a7af-451c-804c-8ffa86f55606 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:20.620553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:20.662459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c970c-a7af-451c-804c-8ffa86f55606 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:20.712389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:20.713031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:20.713305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:20.713580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:20.727973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:20.733267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:20.734234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:20.735041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 256/483] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:20.745978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:20.880274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3a40b-180e-4c27-90eb-e8de8fba1fe0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:20.929545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:20.930194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:20.930478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:20.930754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:20.931430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:20.931737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:20.933115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c7964-642a-4491-b6d9-6153ee6440db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:20.946396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 228/484] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:20.951898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.077643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350468-7227-4cf7-8356-2ba6aec77a5c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.077999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350468-7227-4cf7-8356-2ba6aec77a5c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.078178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350468-7227-4cf7-8356-2ba6aec77a5c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.078404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca3395-45c0-48ad-a7e7-b9868beb0044 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:21.079976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 229/485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:21.086366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.086661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.086925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.105492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:21.106812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:21.109564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:21.121883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:21.122922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.123339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.130989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.136066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:21.137677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:21.152893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:21.153827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:21.154707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:21.154707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:21.154707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:21.156825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 257/486] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:21.158249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:21.162798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.181784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 230/487] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:21.284636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ebf6-78a1-4bab-84d3-998cb484a1db None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:21.333192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:21.333726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.334034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.334308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.334956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:21.335260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:21.336627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa249753-ed85-41fa-8ee6-630a4f1f5448 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:21.353168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 258/488] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:21.358362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.438793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24175-053a-4de5-8323-ef4179f3daef None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.439136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24175-053a-4de5-8323-ef4179f3daef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.439341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24175-053a-4de5-8323-ef4179f3daef None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.441477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 259/489] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:21.446620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83598135-0c42-4307-a753-4f055a0724af None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.446910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83598135-0c42-4307-a753-4f055a0724af None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.447191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83598135-0c42-4307-a753-4f055a0724af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.477638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-83598135-0c42-4307-a753-4f055a0724af None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:21.479599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-83598135-0c42-4307-a753-4f055a0724af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:21.495036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8043f6-271c-4dd3-939c-a8380673ea4e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:21.536138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:21.554802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:21.555478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.555767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.556035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.566152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:21.567599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:21.585058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 260/490] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:21.586225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83598135-0c42-4307-a753-4f055a0724af None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:21.587066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:21.587944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:21.588836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:21.592987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 231/491] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:18:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:21.593842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.639480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:21.700933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83598135-0c42-4307-a753-4f055a0724af None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:21.724473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e864b-4ede-4cb4-b2b9-e9a249ada0d2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:21.739383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:21.740310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.740772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.741317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.752645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:21.758827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:21.759718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:21.760500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:21.762792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 261/492] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:21.770001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.770872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:21.771677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.772127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.772566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:21.773553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:21.774050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:21.775640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:21.818307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 232/493] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:18:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:21.824394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:21.857180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:21.938212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:21.946402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80452ee2-7710-46f3-8388-a3fce0d2832d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:21.983966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:21.984948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:21.985442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:21.985944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.004666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7931c-d313-4b11-9289-0c98e7a5a499 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.062056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.063526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.063658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.064351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.064706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.065056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.066342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:22.066738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.068169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.077088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 262/494] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:22.078130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.169759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.177955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 233/495] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:22.178561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.179472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.195064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6159e-7975-4783-8ac2-4cea15f0c352 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.229974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d629f7-1a79-42fd-a904-45f01b5505df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.230606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d629f7-1a79-42fd-a904-45f01b5505df None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.231079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d629f7-1a79-42fd-a904-45f01b5505df None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.231353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d629f7-1a79-42fd-a904-45f01b5505df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.241302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d629f7-1a79-42fd-a904-45f01b5505df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-18d629f7-1a79-42fd-a904-45f01b5505df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:22.246013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:22.246917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:22.247700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 263/496] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:22.248497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c2f1-723a-4bbd-abee-efcab4bcd6aa None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.248663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c2f1-723a-4bbd-abee-efcab4bcd6aa None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.248980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814c2f1-723a-4bbd-abee-efcab4bcd6aa None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.250676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 264/497] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:22.251780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814c2f1-723a-4bbd-abee-efcab4bcd6aa None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.290910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56450eeb-fddd-43bb-ace5-5e3353882cbd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.324196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.324818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.325101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.325376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.335935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.337389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.351911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814c2f1-723a-4bbd-abee-efcab4bcd6aa None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1590640c-4b01-46d1-ba3d-f57bea1bd804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:22.352319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:22.353248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:22.354110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:22.354110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:22.354110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:22.354110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 234/498] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:22.354597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f41f2-7650-420d-9f61-27c2c5c8b14c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.354886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f41f2-7650-420d-9f61-27c2c5c8b14c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.355159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f41f2-7650-420d-9f61-27c2c5c8b14c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.356383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 235/499] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:22.360514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f41f2-7650-420d-9f61-27c2c5c8b14c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.392512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.393133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.394035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.394321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.404213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.405653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.406425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.414677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-db5c616d-fd85-4047-80dd-5b03e454e6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:22.420996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:22.421931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:22.422764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:22.422764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:22.422764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:22.422764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 265/500] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:22.423315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.423574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.423821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.441624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:22.442845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:22.467108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f41f2-7650-420d-9f61-27c2c5c8b14c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.500097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.500698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.500980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.501254 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.501936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:22.502239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.504116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd6dbe-f707-4b31-a9fb-baada7106b15 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.510665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 266/501] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:22.511498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.516326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 236/502] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:22.516326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.516326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.516326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.536803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:22.538022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:22.610168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 237/503] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:22.610168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.626089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe14de-b721-4244-88de-ce1493f0eafe None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.656971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.662971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.664562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.665245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.665609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.665913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.671078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:22.671078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.671078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.681663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 267/504] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:22.682809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.736241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4b8a3-0537-4ff5-bda8-770e62dd37d2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.772205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.772813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.773093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.773377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.774048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:22.774349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.775728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.788501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 238/505] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:22.789320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.804543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd1e56-b3d7-4923-ac8b-28a4f52e633e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.845414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.846065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.847067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.847303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.858354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.859903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:22.875340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:22.876247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:22.877073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:22.877073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:22.877073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:22.882096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 268/506] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:22.882971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.902917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.906672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb43f4b-093b-4fb5-8d85-8cb097bfba3b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:22.926249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:22.941469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:22.942175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:22.942448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:22.942805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:22.949776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:22.951237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:22.962825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:22.963700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:18:22.964585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:22.966178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 239/507] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:22.967155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:22.983760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e500fa4-1c1b-4c47-96e8-41bb66c7daa2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.018036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.018699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.019046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.019314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.029105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:23.034231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:23.035552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 269/508] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:23.036363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.070686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5d30d-48ec-4cae-ad92-640ef0ed5e95 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.103264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.103876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.104153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.104424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.111158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.113333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:23.125292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:23.126248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 240/509] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:23.127338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.138137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fb0fd-3a99-4fce-bf77-0fb5640f92a3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.139654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.147199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.171413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.172022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.172302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.172577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.173225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:23.173528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.175664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.191614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 270/510] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:23.191614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.228640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf5b5f-337e-456a-a94a-449631a1a603 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.262228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.262850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.263132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.263408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.273260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.274780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.289376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fad0a8-9534-4225-b45d-f8363e3ef5c7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:23.289507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:23.290581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:23.291898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:23.291898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:23.291898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:23.291898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 241/511] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:23.291898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.324594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.325193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.325474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.325749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.326494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:23.326793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.328193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.359107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.365149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 271/512] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:23.370851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.386588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.392835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c45d-7209-4e4c-9b47-e31613db5566 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.427343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.427941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.428241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.428519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.429178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:23.429482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.430891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.438946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 242/513] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:23.439734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.463988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17440c-1b7e-4c8a-81bf-56ca2255b851 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.498903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.499596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.499879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.500147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.500832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:23.501134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.502592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.519781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 272/514] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:23.520600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.540942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117d58-90da-42f4-9232-d2f04d96273d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.572637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.577750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.578394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.578672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.579199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.587547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.588976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:23.600759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:23.601883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:18:23.602915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:23.605039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 243/515] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:23.605825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.606241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.624667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb8a3d-7892-4f6b-9d18-eeed7e845236 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.659949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.660631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.660907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.661174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.661817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:23.662145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.663513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.674301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 273/516] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:23.675206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.712759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f3b7e-d4e2-43c6-aa14-705555af6799 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.745643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.746201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.746488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.746762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.773908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedcbbc-5ba2-449b-b689-0903b67de889 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.804376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.807473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.808097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.808375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.808647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.814445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.815931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.816862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:23.821414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.823200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:23.840481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:23.847105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:23.847958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:23.847958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:23.847958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:23.847958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 274/517] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:23.847958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.923237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 244/518] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:23.924090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:23.942167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548aef5-e6a4-456b-9c67-05fe942e59aa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:23.976465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:23.977062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:23.977344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:23.977618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:23.978375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=63691cb1f90744c497aaddd6139d5e8c) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:23.978687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:23.980104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:23.985580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 275/519] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/role_assignments?user.id=63691cb1f90744c497aaddd6139d5e8c&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:23.986275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.042840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.052654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.054912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2167e3-9e74-4fbb-84b8-6f98b08c1436 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.091408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.092028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.092308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.092583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.093330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:24.093636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.095209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.102561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c886ef-50d6-4e75-9ad1-2360e15bcc2a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.116886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 245/520] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 24 09:18:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:24.117690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.153378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.154048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.154333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.154611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.155253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.156707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.227305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770919-adfe-4773-ab83-772b2c4d6425 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.254040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 276/521] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:18:23 2022] POST /identity/v3/users => generated 247 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:24.254926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.272894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.274290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.274720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.275151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.276087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:24.276532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.278337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.293268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 246/522] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:24.294440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.311447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.403387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212cf1c-3409-4fd0-ba53-5aa2566cc14b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.418891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.421400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a3a81-ca98-4535-84af-55a7481ba928 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.455156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.456903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.456903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.456903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.470357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.471358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.472419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.472892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.473331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.475079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:24.490690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:24.491696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:24.492555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:24.492555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:24.492555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:24.493171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 277/523] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:24.493887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.564866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.567754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.580523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.612926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a8662-8bd5-4b02-8a90-adc550ebedcf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.648876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.649880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.650370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.650850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.658887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.661118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:24.676275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:24.677277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:18:24.678573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:24.680746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 278/524] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:24.681735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.692590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 247/525] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:24.692590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.716381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.792046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ceec1-4806-499c-9fdf-32deebcbdde5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.801779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648965-b7e3-4945-a63e-e130763919ef None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.803554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.833445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.833445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.833445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.833445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.833834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:24.833834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.835164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.843662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:24.843662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:24.843662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:24.843662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:24.844006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:24.844006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:24.844297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:24.857087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 279/526] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:24.858506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.859463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 248/527] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:24.860383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:24.952468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:24.966378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e39eb-2a58-43e1-90fc-a411e1e332a3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:24.970106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a5cc5-08a5-4924-89a8-bdd5ded740f0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.004983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.005592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.005897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.006181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.008797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.009503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.009976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.010256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.024847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.026447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:25.041480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:25.042532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:25.043362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:25.043362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:25.043362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:25.043362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 280/528] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:25.044529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.055021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.092193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.093690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.185312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e520adf-398b-46e7-9200-44fa775758ae None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.216025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 249/529] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:25.216985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.231195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.232102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.232386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.232663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.236413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.242353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.247809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:25.261016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:25.262651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:25.264095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 281/530] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:25.264904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.297402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.341756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce3e7-e793-4420-be92-763f11cb52d2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.382393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ff533-6814-4bdb-be14-a58d119498ad None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.386879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.387575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.387929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.388277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.389003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:25.389386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.391293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.408091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 250/531] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:25.410788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.419903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.420614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.420958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.421293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.433531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.435044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:25.451503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:25.452434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:25.453307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:25.453307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:25.453307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:25.453307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 282/532] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:25.454391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.508499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.546447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec2a96-ed3c-4b35-b62a-4807b8e5219e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.563090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06faeec-27ca-4eee-8735-817834a36824 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.583720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.592317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.593050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.593556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.593664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.594480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:25.594809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.600984 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.606290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.607204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.607715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.608641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.617274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.619031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.620835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 251/533] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:25.622028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:25.634290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:25.635136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:25.635997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:25.638894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 283/534] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:25.640143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.740145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780da6-043e-4f75-b077-042a836353f7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.777243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf91c2d-f29c-4f17-a1eb-651277c1d794 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:25.782752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.783878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.784260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.784633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.785380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:25.785778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.787447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.788685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.803391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 252/535] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:25.804124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.819584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:25.820649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:25.820991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:25.821334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:25.822218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=bef04835da9e450da45248746bb28fe4) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:25.822593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:25.834078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:25.834078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 284/536] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/role_assignments?user.id=bef04835da9e450da45248746bb28fe4&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:25.840065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:25.875042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:25.931803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcd0e-ed9d-4754-9474-5cb21606f81b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:26.005898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef2d3-1655-45a2-bb64-8f144686f08f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:26.023304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:26.023928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.024211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.024484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.025191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:26.025499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:26.027320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2da91-0bbb-4815-ab78-9aeeb502fcef None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:26.043993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 253/537] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:26.052431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90e67-ecf0-4e46-95eb-41176863073a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.052868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90e67-ecf0-4e46-95eb-41176863073a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.053145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90e67-ecf0-4e46-95eb-41176863073a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.054239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:26.055228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.055684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.056138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.057940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 254/538] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:26.061154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90e67-ecf0-4e46-95eb-41176863073a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:26.069225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:26.070716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a4b6e412-47db-46fe-b985-9a0fabace471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:26.084961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:26.085884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 285/539] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.090863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.091416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.116847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:26.118655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:26.162229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:26.184108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90e67-ecf0-4e46-95eb-41176863073a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:26.195480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:26.215155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 286/540] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:26.216355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:26.251253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:26.251870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.252149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.252688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.253550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=af46b3972c53418e8932620410454643) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:26.253881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:26.255722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d6613-824f-4b27-9e28-ff4991bb848b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:26.270916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 255/541] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:26 2022] GET /identity/v3/role_assignments?user.id=af46b3972c53418e8932620410454643&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:26.336253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af521c42-5e4c-4f76-af54-98afe1f45df3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:26.371138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02b58-38e0-4258-9ba4-806cd30b839f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.371652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02b58-38e0-4258-9ba4-806cd30b839f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.371759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb02b58-38e0-4258-9ba4-806cd30b839f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.373327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 256/542] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:26.378925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.379507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.379611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:26.380125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.380228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.380503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.380783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.381492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:26.381799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:26.389885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:26.396934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 287/543] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:26.402624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:26.426965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:26.428552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:26.432151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:26.520426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 257/544] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:26.522400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3341004-7466-4e64-b633-0e7a52b972c1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:26.558513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:26.559133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.559469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.559746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.560526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=072c1d4765474a91b9ceca1727432fd4) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:26.560842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:26.562298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:26.568427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 288/545] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:26 2022] GET /identity/v3/role_assignments?user.id=072c1d4765474a91b9ceca1727432fd4&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:26.607476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:26.750686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daefac-26aa-41ef-9ec2-fa9c874c793d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:26.752192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:26.787197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:26.787761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:26.788048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:26.788326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:26.800236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:26.804917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:26.805784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:26.807041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 258/546] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:26.812216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:26.841727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:26.942366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:26.975583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ace026-ea50-41ef-a799-f271d3957832 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.042752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.043280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.043570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.043852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.044525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:27.044830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.046236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.073349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 289/547] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:27.078914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.079431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aa819-220d-4f57-a786-73e05b56e61b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.129295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.129953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.130236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.130510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.159449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:27.164374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:27.165407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:27.166664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 259/548] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:27.172049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.200705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:27.285339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b95cc-32fb-4130-a312-a03baeadb3b8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.323646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.324174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.324458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.324728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.325394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:27.325693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.327442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.337293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 260/549] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:27.342570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.359846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e599cc-18bc-4778-93de-552952c97173 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.439424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:27.448924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec63dc0-df2f-40f4-b371-ad41b3a6af05 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.486447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.487297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.487576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.487830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.488007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.488157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.488634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.488634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.499179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.500625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:27.516993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:27.519443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:27.521806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:27.521806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:27.521806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:27.521806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 261/550] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:27.522354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.523854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.524225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:27.546184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:27.548629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:27.551375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:27.551375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:27.551375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:27.551375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:27.552722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 290/551] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:27.554720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.697169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4c485-54d3-4d4f-ae70-5ff7dd74ed1b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.740423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.741041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.741324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.741597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.742673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:27.742984 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.744349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.747101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:27.758256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 262/552] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:27.763754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.792679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997f54-bb91-4884-bb7d-49edcbd2de54 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.870853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f960c-80bc-4bc8-8939-8d023d5edcde None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:27.890682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.891318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.891603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.891879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.892556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:27.892862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.894418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.910167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:27.910803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:27.911091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:27.911371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:27.918824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:27.920278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:27.924332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 291/553] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:27.931189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:27.937870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:27.940418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:27.942897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 263/554] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:27.947043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.037187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.058022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.089495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517f85-cb20-4aa9-b3c4-f6e1462c58d7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.124050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd9ecf-0121-43f0-bac0-c92316daa9f6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.126636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.127542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.128029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.128503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.129444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:28.129986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:28.131728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37a86-82ee-47c8-9ee3-8b1de90d2aa6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:28.151396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 264/555] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:28.157286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47ed7b-d0f5-48be-bc92-e33ca2b3d6f8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.157915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47ed7b-d0f5-48be-bc92-e33ca2b3d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.158407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47ed7b-d0f5-48be-bc92-e33ca2b3d6f8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.160988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 265/556] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:28.161978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47ed7b-d0f5-48be-bc92-e33ca2b3d6f8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.169357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.170057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.170385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.170662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.181640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:28.183709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a50add53-1117-452e-b2c8-fecf10602247 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:28.199762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:28.200725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:28.202164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 292/557] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:18:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:28.202750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.202750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.202901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.230034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:28.231647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:28.300099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47ed7b-d0f5-48be-bc92-e33ca2b3d6f8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.314446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 293/558] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:28.315293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.318690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.341757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.342776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.343265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.343781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.419449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:28.421328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:28.426332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.534341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 266/559] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:28.536322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.552729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.559743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5a724-ec58-43b6-ab6b-10fd4e68a87d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.645429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a08ff-8466-4834-9fe3-044313f49638 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.658028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.658687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.658966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.659248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.660111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:28.660418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:28.661845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a9614-1e6a-4f78-9811-3233a2d2a40a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:28.679941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 294/560] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:28.681317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f15c7-0a09-49aa-8ad4-fe9a381a5af8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.681609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f15c7-0a09-49aa-8ad4-fe9a381a5af8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.681984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f15c7-0a09-49aa-8ad4-fe9a381a5af8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.685713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.686647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.686977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 295/561] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:28.687342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.687851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.688130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f15c7-0a09-49aa-8ad4-fe9a381a5af8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.701306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:28.702794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:28.718499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:28.719499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:28.720391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:28.720391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:28.720391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:28.720391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 267/562] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:28.720391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.797378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.802171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f15c7-0a09-49aa-8ad4-fe9a381a5af8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.812565 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:28.836025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e598f-a9cd-4171-b154-94129895d040 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:28.840533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b81d4-8b8d-4acb-a0fa-eb8c44b057d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.841168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b81d4-8b8d-4acb-a0fa-eb8c44b057d9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.841450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b81d4-8b8d-4acb-a0fa-eb8c44b057d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.841722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b81d4-8b8d-4acb-a0fa-eb8c44b057d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.852674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b81d4-8b8d-4acb-a0fa-eb8c44b057d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6a2b81d4-8b8d-4acb-a0fa-eb8c44b057d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:28.857418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:28.858493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:28.859338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 296/563] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:28.860197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ed9e-b132-4292-93c9-5c2d4fba61f2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.860197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ed9e-b132-4292-93c9-5c2d4fba61f2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.860197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ed9e-b132-4292-93c9-5c2d4fba61f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.873552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:28.874291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.874576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.874854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.885162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:28.886661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:28.900834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:28.901787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:28.902718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:28.902718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:28.902718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:28.902718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 268/564] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:28.903360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:28.910806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bd27ed9e-b132-4292-93c9-5c2d4fba61f2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:28.911993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd27ed9e-b132-4292-93c9-5c2d4fba61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:28.981716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 297/565] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:28.983000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65370b-6a11-458a-85e4-f2e00f4f52ea None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:28.983288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65370b-6a11-458a-85e4-f2e00f4f52ea None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:28.983620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65370b-6a11-458a-85e4-f2e00f4f52ea None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:28.984891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 298/566] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:28.987343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65370b-6a11-458a-85e4-f2e00f4f52ea None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.005154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3266e-5654-40bd-b6ab-3e62b5379132 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.022404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.040715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.041320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.041601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.041895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.042543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:29.042844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.044192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.060804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 269/567] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:29.060804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.098603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.103521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65370b-6a11-458a-85e4-f2e00f4f52ea None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.138250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.138959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.139302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.139665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.140391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:29.140779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.142236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d561e46-32fa-4cce-b982-807cb3e24f68 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.155527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 299/568] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:29.155527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.155527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.155527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.166429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c06656-7850-4caf-9f3d-53edede8c516 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.176122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:29.177691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:29.205309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.206906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.207197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.207461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.208102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:29.208403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.209781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.221064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 270/569] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:29.221997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.254479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 300/570] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:29.255621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.261912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.325563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda23a4-c9fd-4c3a-94b6-b156f4f41dc4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.360686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.364938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.365562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.365841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.366144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.371536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653985d-644f-4be7-9729-b4d854386c52 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.372912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.376301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:29.386291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:29.387355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:29.388337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 271/571] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:29.388914 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.410664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.411567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.412075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.412502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.423423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.425811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:29.440458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:29.441967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:29.442858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:29.442858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:29.442858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:29.442858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 301/572] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:29.442858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.499275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.503815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbb618-fd4e-4438-a88c-fde1d82f9c3a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.538253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.538885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.539146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.539420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.545900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4803d0-57d4-4fc3-bc1a-396dbb8862c6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.546692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.548127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:29.559579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:29.560662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:29.561742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:29.565537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 272/573] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:29.566306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.580307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.581558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.581837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.582165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.592151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:29.598112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:29.599193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:29.600039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 302/574] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:29.600711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.603303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.665659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43c0e8-148a-4b30-9aa3-0d410204c506 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.699165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b110e94-da08-4f86-9ce7-cb48eca56218 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.700037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.700641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.700921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.701198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.701926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:29.702236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.703926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.716250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 273/575] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:29.717168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.735408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.736013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.736291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.736600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.736767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.737236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:29.737541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.738945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.754665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 303/576] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:29.754665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.811661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.820394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86c71-1ac9-4352-8f16-7175c08ea440 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.852902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3a26e-4af4-4c95-8382-a2308bed1031 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:29.857248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.857897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.858185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.858458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.869385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:29.874077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:29.875135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 274/577] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:29.876151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.891838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:29.892446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:29.892727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:29.893042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:29.893941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:29.894254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:29.895672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:29.907431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 304/578] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:29.908226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:29.955096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:29.976616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b8a5-5fcc-49d6-8477-96f12d3ad2c1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.007740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e95fc6-3532-413c-8bd1-7ac6ae690f14 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.010996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.011620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.011902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.012178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.012843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:30.013145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.014542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.023709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 275/579] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:30.024504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.037014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.047544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.048143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.048418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.048686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.050169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=8c16b4dc236344ffa2ef8cab86d6594e) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:30.050634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.052043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.057196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 305/580] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:29 2022] GET /identity/v3/role_assignments?user.id=8c16b4dc236344ffa2ef8cab86d6594e&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:30.058003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.132915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271b7a-d03f-4f57-a7ea-9fcaad86349a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.170123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.170759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.171038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.171307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.180382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.181867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.184729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.188670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06217b7-ff9b-472a-911d-59529f71ac77 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:30.194560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:30.198443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 276/581] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:30.199609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.233932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.234484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.234764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.235050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.235690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:30.235996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.238016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.246234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 306/582] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:30.247037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.302626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.315776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9d6ba-4d74-4378-a064-ab5a151d2272 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.356045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987586c-d8b7-4ba9-bb2e-3ca8a5a83339 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.359029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.359683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.359963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.360237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/63691cb1f90744c497aaddd6139d5e8c/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.375386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=63691cb1f90744c497aaddd6139d5e8c, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.376819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.391160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.391791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.392073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.392347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.404470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.405944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:30.420483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:30.421428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:30.422775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:30.422775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:30.422775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:30.422775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 307/583] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:30.422775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.454164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 277/584] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:30 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/63691cb1f90744c497aaddd6139d5e8c/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:30.455908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.536412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.547783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.551414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190fa5f-4408-4915-b3bd-c74f3e5631be None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.591312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.592077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.592474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.592855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.593678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:30.594080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.595679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.600095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd793a-cd1f-49a9-8d17-17a7ae37418c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.619613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 308/585] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:30.620563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.648103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.648736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.649021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.649297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.665681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.668383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:30.687214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:30.688217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:30.689091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:30.689091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:30.689091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:30.692552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 278/586] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:30.693450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.745638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b3e5e-a45f-4fd1-a826-1613faee8fb9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.781502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.782518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.782998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.784014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.785169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:30.785676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.787314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.804705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 309/587] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:30.805964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.821734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b079-c1a6-4143-bb21-d01695d7679d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.827435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.870065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.870701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.871239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.871524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.875095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:30.886791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.891835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:30.913432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:30.914439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:30.915325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:30.915325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:30.915325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:30.915325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 279/588] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:30.916014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:30.928154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8a25-d348-41e4-b9cd-a1626ab61b82 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:30.971114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:30.972673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:30.973181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:30.973660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:30.974587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:30.975622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:30.977689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:30.997622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 310/589] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:31.003423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.034788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ba2ab-29e8-4268-b6cb-ee720f70e29a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.074367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.075183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.075470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.075748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.085822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.087322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.090511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:31.100528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:31.101887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 280/590] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:31.109004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.113275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3e6ba-3ef6-41a6-a727-714d03d6f206 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.126018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.151740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.152635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.153075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.153494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.154368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:31.154816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.156952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.176796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 311/591] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:31.178104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.250628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056c02d-71dd-461d-86b4-d08ee074bf38 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.286264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8700bc-6329-4b63-bffd-2f53d8bbdc00 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.300023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.300658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.300951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.301592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.311320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.313342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.322112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.322905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.323333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.323754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.324720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:31.325172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:31.326427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:31.327531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:31.328823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 281/592] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:31.329424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.329930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.339601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.351418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 312/593] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:31.352680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.431205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.458423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0121f1-8084-45eb-a5dd-9acc96b0a5fe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.464484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c8d4f-250d-4d78-8cf5-9d1cd7967f5d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.497762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.498764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.499291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.499729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.500618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:31.501067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.503448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.508001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.508634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.508920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.509331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.519612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.522129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.531238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 313/594] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:31.532340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:31.535047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:31.535918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:31.536821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 282/595] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:31.544207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.621338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.654142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c9f60-5c86-43dc-873c-b7cfd174628b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.683480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37611f76-f188-433c-ac69-976a7f4fa041 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.694759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.695539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.695888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.696239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.697099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:31.697474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.699229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.701318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.714275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 283/596] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:31.715366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.726539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.727186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.727470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.727770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.747116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.749387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:31.768554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:31.769542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:31.770437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:31.770437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:31.770437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:31.776087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 314/597] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:31.776087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.856293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0b4e-9b7f-47ad-ae7d-493a91f5936c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.890768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29f5bb-25ab-4d61-b93f-dc5e8e199c75 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:31.900006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:31.905507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.906610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.907093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.907906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.921982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.938199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:31.938331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:31.938331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:31.938331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:31.938331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/bef04835da9e450da45248746bb28fe4/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:31.944884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:31.945888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:31.946794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:31.946794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:31.946794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:31.950019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 284/598] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:31.951597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=bef04835da9e450da45248746bb28fe4, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:31.952263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:31.954218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.003998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:32.057326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be0459-228f-45b1-a6a7-ef8c27e2f56e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.093881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 315/599] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:31 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/bef04835da9e450da45248746bb28fe4/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:32.093881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.104096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.104790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.105184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.105465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.106187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:32.106487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.108037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d18b6-f0c8-44c8-82ea-209656482c46 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.123981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 285/600] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:32.125589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d1a8-f01d-4e4e-ac12-8584a2d92307 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.125891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d1a8-f01d-4e4e-ac12-8584a2d92307 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.126166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d1a8-f01d-4e4e-ac12-8584a2d92307 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.129992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 286/601] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:32.131577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d1a8-f01d-4e4e-ac12-8584a2d92307 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.218645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206c4c-3f81-49c1-8f81-81ba22a4b3a1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.260540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.260966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.261247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.261518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.262197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:32.262498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.263850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaea1fc-818d-47db-a61e-10053575217f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.280045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 316/602] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:32.281064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d1a8-f01d-4e4e-ac12-8584a2d92307 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.281776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.282357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.282940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.294032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:32.303294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:32.303730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:32.317558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:32.334366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.335049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.335329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.335612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.352235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.354197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:32.373519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:32.374502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:32.375423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 287/603] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:32.375918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.389130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 317/604] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:32.390315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.560112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812413f2-8c17-41e3-8c2d-0f6381fef386 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.564463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5d0ac-6a2d-40ff-9a17-e76d415546e3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.600580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.602258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.603675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.604333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.605746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:32.606290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.607852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8113-7678-45cf-b181-35933444bd93 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.616150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.616910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.617290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.618194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.625890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 318/605] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:32.626364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.627728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.628083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac53b-c8e8-459e-80cb-8835946b9158 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.628513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac53b-c8e8-459e-80cb-8835946b9158 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.628920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dac53b-c8e8-459e-80cb-8835946b9158 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.630858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 319/606] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:32.632675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac53b-c8e8-459e-80cb-8835946b9158 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-60cd41c1-fa2f-4599-8e28-6cf596ba470c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:32.644637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:32.645539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:32.646461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:32.646910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:32.649275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 288/607] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:32.650720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.651219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.651693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.672215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:32.674298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:32.696635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:32.745960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 289/608] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:32.746462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.761683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dac53b-c8e8-459e-80cb-8835946b9158 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.805131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.806545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.807272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.807720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/af46b3972c53418e8932620410454643/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.827207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=af46b3972c53418e8932620410454643, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.828898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.863745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b24689-f165-4083-93c0-0f9653687eed None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:32.899288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:32.899896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:32.900177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:32.900459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:32.901143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:32.901447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:32.903045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:32.917946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 290/609] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:32.917946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.929191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 320/610] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:32 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/af46b3972c53418e8932620410454643/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:32.934118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:32.965378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:33.052532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:33.094411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178f35b-a39e-4d8f-9872-e3de2b44528a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.117373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685280d7-39d7-45eb-bb0a-1f15ec39f2b5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.146088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.147130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.147428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.147845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.155439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.156267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.156559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.157134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/072c1d4765474a91b9ceca1727432fd4/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.160299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:33.166662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:33.167596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:33.168478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 291/611] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:33.169183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:33.184483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=072c1d4765474a91b9ceca1727432fd4, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:33.186590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:33.253745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 321/612] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:32 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/072c1d4765474a91b9ceca1727432fd4/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:33.259556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:33.261942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:33.348747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3714fc-056f-4de1-996e-65e7815a7263 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.408114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b9a09-a435-4957-b6bc-f6a7dbbf15f2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.421690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.422657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.423092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.423531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.425941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:33.449675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:33.454878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:33.456374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:33.460262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 292/613] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:33.465341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:33.477824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.479249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.479710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.480662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.481795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:33.482271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:33.484602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:33.497880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 322/614] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:33.504547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:33.631376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4e3e-c62e-44b8-a227-6abdad563d52 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.634894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5917d-b594-4434-8d1b-420721447c3e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.676193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.677158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.677599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.678173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.691792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:33.693738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:33.711241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:33.712413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:33.713520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:33.713520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:33.713520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:33.715649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 323/615] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:33.722320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:33.747786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:33.751150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.751785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.752105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.752378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.753051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:33.753357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:33.755041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:33.763319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:33.773590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 293/616] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:33.779013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:33.844592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7de25-ead4-4ac7-a2ce-649fb03123f0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:33.886720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:33.887793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:33.888555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:33.888995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:33.889783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:33.890244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:33.891888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:33.906227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 324/617] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:33.912558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.007054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.035503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51bd4-5085-4bf9-b41b-77cab4adc04c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.048498 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076444a-d5e5-4e7f-bbca-d3b9176ade03 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.086110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.086907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.087279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.087637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.087764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.088804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.089326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.089752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.096260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.097916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:34.109728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:34.110918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:34.113010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:34.119416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 325/618] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:34.121887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.123621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.125122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:34.150745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:34.151989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:34.153054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:34.153054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:34.153054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:34.159297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 294/619] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:34.165889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.255493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.290015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893dea0-01c7-4cdd-b337-72730fa751a6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.312047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f52a4-77c7-43d6-a3c3-799b1efd81bb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.324060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.324762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.325111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.325457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.326307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:34.326687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.328171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a59da4-a775-4956-aa7e-9fded6325aab None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.338271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.347306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 326/620] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:34.348651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc00f-e936-4f61-aab3-097e896ee702 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.349043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc00f-e936-4f61-aab3-097e896ee702 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.349380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc00f-e936-4f61-aab3-097e896ee702 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.350978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 327/621] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:34.351651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.352263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.353440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc00f-e936-4f61-aab3-097e896ee702 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.356672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.357018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.357639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:34.358000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.359384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea155634-898d-4c38-88f2-9cb3aecebce1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.374482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 295/622] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:34.375862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.376156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.376541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.396898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:34.398129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:34.472450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc00f-e936-4f61-aab3-097e896ee702 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.482696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 296/623] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:34.483711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.509006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.509725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.510037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.510316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.520971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.522489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:34.539021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:34.540044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:34.540916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:34.540916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:34.540916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:34.540916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 328/624] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:34.546427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.567404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.606278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.655396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6212f-3aec-48af-9cb1-9a3a195b4429 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.691986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.692684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.692971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.693245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.693978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:34.694296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.695798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.708811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 329/625] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:34.714132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.747842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb276a59-ecbd-4f89-b0e2-ba1aad4b9adb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.822691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65b78-145b-4885-871c-6425db67d42d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:34.838325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.847164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.848109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.848219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.848497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.855893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.857437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.866381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:34.874654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:34.874654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:34.874654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:34.874912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:34.875799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 297/626] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:34.876754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.878897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:34.880598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:34.894011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:34.894971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:34.895840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:34.898519 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 330/627] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:34.903919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:34.980743 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:34.983738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9c9e3-2ca6-44f1-9b05-5e391bdc2f51 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.016641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6f986-e92f-4eb6-811d-6b9f957d5682 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.020482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.020901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.021248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.021614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.032228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:35.038141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:35.039121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:35.039942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:35.044190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 298/628] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:35.045117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.060059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.061170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.061889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.062329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.063204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:35.063656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.065435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.089319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 331/629] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:18:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:35.090190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.132020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:35.154366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c455-306f-4bff-9e36-e6a2cfee6335 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.194572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.195193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.195479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.195759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.196463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:35.197211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.198936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.209578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2182a5-85bf-4fb5-8540-e6bab03ad667 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.218264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 299/630] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:35.218264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.244656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.244997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:35.245257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.245541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.245811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.246508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:35.246809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.248160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d398be-bd70-4d7c-a27f-15900896a0b2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.257101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 332/631] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:35.258517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceec5b-4b8f-4d11-9518-f1083be170a8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.258803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceec5b-4b8f-4d11-9518-f1083be170a8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.259075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceec5b-4b8f-4d11-9518-f1083be170a8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.261936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 333/632] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:35.261936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceec5b-4b8f-4d11-9518-f1083be170a8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.342855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd959a0-1096-4974-b3ac-1fc841b9ea26 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.360504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:35.371465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceec5b-4b8f-4d11-9518-f1083be170a8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.381387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a9321-2b65-4bed-9891-d0bece78383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.382030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9321-2b65-4bed-9891-d0bece78383b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.382317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9321-2b65-4bed-9891-d0bece78383b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.382599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9321-2b65-4bed-9891-d0bece78383b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.408022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.409868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.410316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.410721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/8c16b4dc236344ffa2ef8cab86d6594e/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.427132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=8c16b4dc236344ffa2ef8cab86d6594e, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.429448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.454502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a9321-2b65-4bed-9891-d0bece78383b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.456295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a9321-2b65-4bed-9891-d0bece78383b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.477406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:35.515405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 334/633] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:35 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/8c16b4dc236344ffa2ef8cab86d6594e/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:35.516206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.566592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 300/634] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:35.566592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181767a9-8c61-4c55-803f-327f86d81ae5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.566592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181767a9-8c61-4c55-803f-327f86d81ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.566592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181767a9-8c61-4c55-803f-327f86d81ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.584237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-181767a9-8c61-4c55-803f-327f86d81ae5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:35.585468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-181767a9-8c61-4c55-803f-327f86d81ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:35.646434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b09fe-158c-4187-bbf6-0ea8ceab6e71 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.664200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 301/635] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:35.665445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933b29b-b7ad-4241-ae97-eb4dcea08e55 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.665735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933b29b-b7ad-4241-ae97-eb4dcea08e55 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.666037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933b29b-b7ad-4241-ae97-eb4dcea08e55 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.667534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 302/636] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:35.668047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933b29b-b7ad-4241-ae97-eb4dcea08e55 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.689740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.691066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.691547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.691824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.702407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:35.704758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.706844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-52f5256b-0715-4fb5-a9b3-18669351a42a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:35.725313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:35.726361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 335/637] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.727225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.735421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:35.743941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:35.745155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:35.796240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933b29b-b7ad-4241-ae97-eb4dcea08e55 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:35.818017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 336/638] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:35.821586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.852740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:35.854234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:35.854511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:35.854785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:35.876425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:35.878852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:35.915105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:35.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:35.916985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:35.916985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:35.916985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:35.925217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 303/639] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:35.926548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:35.988523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53da6d-27e5-4ed6-bbaf-25bd982a0ed7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.013696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.027704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.028548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.029009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.029359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.030116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:36.030489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.032048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.044941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 337/640] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:36.049499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.059728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f1d9e-161c-4920-980b-61471d34a3dd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.076311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.104964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.105579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.105881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.106192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.106853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:36.107160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.108664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.121139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 304/641] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:36.122081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.169679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45e8c8-262c-49b5-af89-c3a44121b074 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.204948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.206456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.206795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.207077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.218274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:36.224363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:36.225297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:36.226169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 338/642] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:36.226848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.233077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d388-7c21-4f8e-8282-adf20d97d767 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.270287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.270917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.271198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.271470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.275909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.280234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.281711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:36.293189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:36.294368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 305/643] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:36.295339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.324527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.340561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7063e81-8de2-4dbd-90a6-2058e2d8c3fd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.374729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.375358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.375636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.375913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.386925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:36.392930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:36.393997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:36.394919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 339/644] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:36.395746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.406762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d46c3b-e243-431e-8f5c-596fadb80165 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.445514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.446088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.446370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.446639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.457160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.459804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:36.472291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:36.473201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 306/645] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:36.474163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.511685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00641e58-9df0-43be-b30d-5d86dbd63177 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.513712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.546351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.547045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.547336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.547615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.548280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:36.548586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.550505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.561187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.563324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 340/646] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:36.564207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.581351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28585f00-fa0f-41a1-ae51-83f85f0fc180 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.625156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.626089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.626379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.627502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.628241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:36.628700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.630622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.654423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 307/647] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:36.654423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.676062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299fc0d-3e36-4e3f-9199-a4dfc54d3c55 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.716721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.717731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.718186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.718578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.719250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:36.719559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.721998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.737912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 341/648] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:36.737912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.759745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e8e1-9f93-4a97-9cdf-2f2da555d969 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.766442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.797525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.798158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.798437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.799437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.800480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:36.800791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.802233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.810964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:36.814793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 308/649] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:36.819563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.846801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1990b-4e98-47aa-98d9-9aae277a484c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.885978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.886720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.887033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.887387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:36.899422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:36.900852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:36.915948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:36.916917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:36.917810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:36.917810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:36.917810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:36.917810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 342/650] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:36.917810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:36.932615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca357-6438-4390-833d-86c9f36ab564 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:36.968111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:36.968480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:36.968767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:36.969046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.006809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.030920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711f298-0c8f-4c11-a4d9-605b63ff9de8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.039110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.041812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.043342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.073167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.073804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.074185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.074478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.086636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.088055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:37.102706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:37.103687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:37.104583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:37.104583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:37.104583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:37.104583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 343/651] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:37.104814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.161064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 309/652] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:37.161064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.220473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce364-fe84-4a9a-9783-5cec72230767 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.250644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.256962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.257569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.257865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.258161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.258889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=63691cb1f90744c497aaddd6139d5e8c) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:37.259201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.260824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.265321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.271138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 344/653] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/role_assignments?user.id=63691cb1f90744c497aaddd6139d5e8c&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:37.271138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.275358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347be2-bd76-42b6-8100-1eea21c7610d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.321117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.321740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.322063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.322342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.323013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:37.323325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.324726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.339121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 310/654] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:37.340312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.400714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062c7e-f56a-4989-82e7-4106585c569a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.441715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.442392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.442657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.442934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.443580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:37.443888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.445370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.459277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 345/655] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:37.459957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.484789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99277e15-a8d5-4076-854b-9cfe26eabeb2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.525840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.526502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.526787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.527061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.533673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.544494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.546160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:37.562830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:37.563920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:37.566048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:37.566048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:37.566048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:37.566048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 311/656] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:37.566048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.581447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.589771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ec0bf-fcfe-4630-b877-532661abf38d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.626971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.627910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.628259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.628607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.636623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.638162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3a766f03-853a-4e93-bac5-fd8fe5cf3636 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:37.649413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:37.650747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:18:37.651913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:37.653991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 346/657] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:37.656116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb49f8-78e0-42aa-b3d5-ad0b43416385 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.656401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb49f8-78e0-42aa-b3d5-ad0b43416385 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.656677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb49f8-78e0-42aa-b3d5-ad0b43416385 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.660016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 347/658] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:37.660016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb49f8-78e0-42aa-b3d5-ad0b43416385 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.676921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc65cc3-f7da-49e6-891f-a57b9ca74f8a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.713341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.714004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.714290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.714565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.723597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.725050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:37.737374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:37.738512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 312/659] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:37.739448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.781371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb49f8-78e0-42aa-b3d5-ad0b43416385 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.796149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.817575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.818218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.818497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.818769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.819420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:37.819721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.821328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356d38b-6e61-44d5-ae45-f786769b068c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.821585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:37.837248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 348/660] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:37.838607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.843340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.843340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.858887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:37.860239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:37.864313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea224-6db4-496c-a0a8-0180b6ab4e1d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:37.900735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234299ac-097c-476c-8141-6c149148a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:37.901339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234299ac-097c-476c-8141-6c149148a375 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:37.901614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234299ac-097c-476c-8141-6c149148a375 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:37.901913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234299ac-097c-476c-8141-6c149148a375 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:37.902635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234299ac-097c-476c-8141-6c149148a375 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:37.902938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234299ac-097c-476c-8141-6c149148a375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:37.904350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234299ac-097c-476c-8141-6c149148a375 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:37.921602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 313/661] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:37.922454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234299ac-097c-476c-8141-6c149148a375 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:37.942380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 349/662] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:37.946762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.044155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234299ac-097c-476c-8141-6c149148a375 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.072774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dfa44-5e2e-4406-b518-eed8020322b4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.075420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.082276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.090050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.090751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.091104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.091597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.092392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:38.092976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.094474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.119307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.119908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.120196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.120397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 314/663] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:38.120505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.121565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.130233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.131746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:38.146644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:38.147587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:38.148489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:38.149949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 350/664] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:38.150989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.244420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463740e-3d9a-41b9-9cf4-c049cee43982 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.265325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9984be-8847-4386-8127-d52b2fcf75fb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.280241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.280968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.281251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.281637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.304088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.304617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.304897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.305169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.338210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.340564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.353652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.355123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.382693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.384125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.465916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 315/665] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:38.466771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.494309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 351/666] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:38.495648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.563317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.565326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.577454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19368e1a-5e72-4c92-892c-9de1df7955d1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.608209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539afa2-9eec-47f4-a04b-588a37db9047 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.613532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.614311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.614420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.614698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.615386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:38.615691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.617533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.629908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 316/667] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:38.630712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.650860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.651492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.651775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.652052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.662997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:38.668905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:38.669940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:38.670801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 352/668] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:38.671516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.739724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae9d4d-0370-4c4e-8cd6-b77feae91996 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.776265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.776890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.777198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.777473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.778885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b696bc-5079-42b6-b305-e2f2c4ef6bd5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.789525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.791007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.799521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:38.805736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:38.809204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:38.810250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:38.810250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:38.810250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:38.810250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 317/669] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:38.810250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.812945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:38.828588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.829236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.829524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.830353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.841327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.842961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:38.858356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:38.859379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:38.860260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:38.860260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:38.860260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:38.864016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 353/670] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:38.864880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:38.931002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5352f-e7a3-4713-9cc8-2e5b00f44475 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.967504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:38.968106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:38.968379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:38.968646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:38.969362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=bef04835da9e450da45248746bb28fe4) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:38.969667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:38.971335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:38.972115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf54f8d-4aed-4f45-9c93-c9b7faabc90d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:38.985888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 318/671] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/role_assignments?user.id=bef04835da9e450da45248746bb28fe4&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:38.985888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.018814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.019747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.020441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.020789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.021814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:39.022203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.024518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.036352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 354/672] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:39.037241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.063290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.097441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.110614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76384862-5960-4517-9d4f-958deebc0557 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.155515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.156074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.156365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.156637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.157290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:39.157601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.159072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.173489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 319/673] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:39.174642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.185306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d6c24-a9a4-455c-898c-4aac6ff30ac0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.231281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.231281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.231281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.231281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.231763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:39.231763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.233667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.247536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 355/674] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:39.248616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.303375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c730-0848-4316-9050-4744809ff7fe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.339666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.355620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.356463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.356951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.357574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.368873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.370865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.374158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.382120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e32e7-cb32-4464-9a89-27dc2e5f7320 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:39.386577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:39.387493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:39.388400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:39.388400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:39.388400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:39.392921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 320/675] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:39.393960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.419823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.420592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.421176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.421299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.428682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.430247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-60e456b3-ca1b-4937-bf3f-ea605f10cffe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:39.442170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:39.443300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:39.444405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:39.445126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 356/676] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:39.446504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833a9f-7fd6-4366-990a-2009344d2f51 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.446846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833a9f-7fd6-4366-990a-2009344d2f51 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.447182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52833a9f-7fd6-4366-990a-2009344d2f51 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.448661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 357/677] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:39.449211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833a9f-7fd6-4366-990a-2009344d2f51 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.513565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08c332-82dd-427a-9210-9db7e27eadac None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.549512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.550324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.550712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.551105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.558110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.559695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.561168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52833a9f-7fd6-4366-990a-2009344d2f51 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:39.571187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:39.572271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:39.573426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:39.578961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 321/678] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:39.580441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.602927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.603537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.603823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.604100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.604748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:39.605060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.606533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbd585-664d-4e3b-a588-d323bb2abaa9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.618622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 358/679] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:39.623072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.623072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.623072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.624703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.638741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:39.640050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:39.654599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.692196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfeba9-371b-4645-98b3-a6586100b1a9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.710761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 359/680] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:39.711848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.740035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.741065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.741448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.741823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.742906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:39.743344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.745562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.761497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 322/681] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:39.763094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.839203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abc3f2-b236-4c8d-a725-874a20744a05 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.877548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.878506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.879252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.879557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.879914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.880675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:39.881129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.882581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.885058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf19e1-f3be-4479-b878-d59d6cb59d80 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:39.895410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 360/682] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:39.896229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:39.907659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:39.921302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:39.922384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:39.922877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:39.923371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:39.930896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:39.932561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:39.945008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:39.949044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 323/683] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:39.950042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.007015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a0300-cfa7-4aa3-aa68-305c178e2515 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.052307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.053386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.053827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.054360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.054658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5af1f-da43-4dde-b439-75e6d1a8212e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.055402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=af46b3972c53418e8932620410454643) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:40.055853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.058336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.073882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 361/684] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/role_assignments?user.id=af46b3972c53418e8932620410454643&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:40.073882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.105032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.105746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.106124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.106471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.107283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=072c1d4765474a91b9ceca1727432fd4) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:40.107663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.109176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.116890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 324/685] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:39 2022] GET /identity/v3/role_assignments?user.id=072c1d4765474a91b9ceca1727432fd4&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:40.117951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.146701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:40.175060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:40.216961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb0ea3-e0ac-44cc-a553-36b5e36e521a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.265364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.266417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.266840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.267819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.269111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:40.269590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.271291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.299234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 362/686] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:40.306208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.308959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc75a2-5804-4baa-8d12-106e91b848b4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.355144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.355782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.356067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.356346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.368694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:40.373924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:40.374883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:40.375730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:40.376388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 325/687] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:40.383425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.454554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9075e-b4ac-48d6-b6b2-6e271648d890 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.478279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:40.495026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:40.499288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b6478-963a-40f6-9885-89717926c9fb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.503300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.504147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.504592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.505019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.545504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.546430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.546888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.547313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.548126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:40.549598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.551667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.565036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 326/688] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:40.574876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.600917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.602420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.749961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777eb753-6c4d-41a6-b678-529cdf141385 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.761628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 363/689] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:18:40.762920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.795194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:40.810161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.813773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.813773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.813773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.854755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.856234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.863829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:40.877630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b989b17-d9d7-4911-b13b-0ac7b6761029 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:40.887979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:40.888964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:40.895414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:40.895414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:40.895414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:40.895414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 327/690] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:40.895963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:40.943186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:40.943835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:40.944108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:40.944375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:40.967201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:40.968643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:40.999530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:41.000596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:41.002151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:41.002151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:41.002151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:41.010107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 364/691] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:41.011427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.046397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e1e44-6269-4e5e-b0bd-9884e2e42d02 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.083821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.084440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.084723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.084999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.085652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:41.085983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.087408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.101440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 328/692] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:41.106894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.186725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.194652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.214598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700d19a-13bb-4400-b540-318f367685d7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.222567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19163bed-1727-40d2-b2ea-bcc8de48fc34 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.253770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.254562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.254844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.255113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.262664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.264273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:41.276910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:41.277909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:41.279589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 329/693] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:41.284753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.289277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.289922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.290209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.290485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.291144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:41.291449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.292826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5635a-62c1-4160-9d89-e645c8837d5f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.306321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 365/694] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:41.307608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f669-9478-4bac-9229-5ef591c21a3d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.307892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f669-9478-4bac-9229-5ef591c21a3d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.308170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2f669-9478-4bac-9229-5ef591c21a3d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.309623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 366/695] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:41.314655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.315036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.315408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.333752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:41.335098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:41.402282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420863b4-7a39-4628-8469-0905d3fc68f9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.404679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 367/696] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:41.405629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.418531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.442239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.442894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.443174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.443449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.444175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:41.444476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.445926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.466929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 330/697] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:41.473456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.480679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.511814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34d04-b4a1-4f97-a945-e0880459eeb0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.550982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.551650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.551933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.552206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.568925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.570418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.588176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8f90-2da3-4116-bbe1-57295b26c9ef None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:41.596463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:41.597457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:41.598430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:41.602050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 368/698] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:41.611738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.632498 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.633126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.633445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.633721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.680921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.709497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.711033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.766332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3a4b-011a-445e-a423-351f50b31c16 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.811045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.817893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 331/699] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:18:41.823159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.823315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.824154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.824613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.825067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.825992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:41.826475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:41.828354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:41.841653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 369/700] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:41.854926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:41.905317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:41.937696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05f22-0983-4354-9bbe-d78001d2274f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:41.983556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:41.985109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:41.985606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:41.986220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:41.993340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d71095-05ca-450b-8808-651c9070abbe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.002942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.005579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:42.026972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:42.027934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:42.028831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:42.028831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:42.028831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:42.030821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 332/701] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:42.031769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:42.038100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.038844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.039216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.039587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.040417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=8c16b4dc236344ffa2ef8cab86d6594e) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:42.040821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.042378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.058185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 370/702] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:41 2022] GET /identity/v3/role_assignments?user.id=8c16b4dc236344ffa2ef8cab86d6594e&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:42.059352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:42.162857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b9bf-61a5-4a27-9fbf-d412671b326a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.193928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:42.210582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:42.226732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.226732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.226732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.226732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.305472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d69cd-97f7-4bc5-baf1-6ffe13676303 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.354559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.356680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.357174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.357645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.358524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:42.359047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.360629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.381421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 371/703] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:42.382087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.382937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:42.383572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:42.404497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:42.405497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:42.406437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:42.406437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:42.406437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:42.410017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 333/704] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:42.413145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:42.518013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47ba59-e125-416c-a5a4-9878ea7b442d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.550443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b23e-68f8-43b9-abbf-866967a47cc0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.593807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.594389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.594675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.594951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.596257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:42.596593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.598156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7628ef2-c3d0-42cd-b6c7-55aa42ab1618 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.612227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 334/705] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:42.613572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e499-03bd-4b01-a95a-e726fed0195d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.613879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e499-03bd-4b01-a95a-e726fed0195d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.614187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e499-03bd-4b01-a95a-e726fed0195d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.615784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 335/706] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:42.619654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e499-03bd-4b01-a95a-e726fed0195d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:42.655620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:42.662600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:42.677419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.678667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.679122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.679637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.687956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.690317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9839beb7-b658-4e8e-b109-3c7c3f485103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:42.702541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:42.709915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 372/707] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdefe1-2f7d-48dc-925a-7a6f98e4a428 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.710817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdefe1-2f7d-48dc-925a-7a6f98e4a428 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.711421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdefe1-2f7d-48dc-925a-7a6f98e4a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.725875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7cbdefe1-2f7d-48dc-925a-7a6f98e4a428 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:42.727097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7cbdefe1-2f7d-48dc-925a-7a6f98e4a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:42.739814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e499-03bd-4b01-a95a-e726fed0195d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.777247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c701d03-795f-48a4-aa02-ca7f8aa0dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.777953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c701d03-795f-48a4-aa02-ca7f8aa0dac7 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.778239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c701d03-795f-48a4-aa02-ca7f8aa0dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.778512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c701d03-795f-48a4-aa02-ca7f8aa0dac7 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.779148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c701d03-795f-48a4-aa02-ca7f8aa0dac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.780610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c701d03-795f-48a4-aa02-ca7f8aa0dac7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:42.798087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 373/708] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:42.799533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96755d-fbec-4052-beee-935a4dd86f17 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.799816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96755d-fbec-4052-beee-935a4dd86f17 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.800091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96755d-fbec-4052-beee-935a4dd86f17 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.806574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 374/709] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:42.806574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96755d-fbec-4052-beee-935a4dd86f17 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:42.870335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 336/710] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:18:42 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:42.871792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.872172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.872540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.914820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:42.916233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:42.936218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96755d-fbec-4052-beee-935a4dd86f17 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:42.946265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:42.979060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:42.980121 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:42.980936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:42.981549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:42.982570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:42.983049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:42.984832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.012871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 375/711] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:43.019256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:43.074099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 337/712] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:43.093712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:43.119264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:43.171767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa44c1-e94f-4089-bee9-c2276170bb9a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:43.218284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:43.219236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:43.219780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:43.220316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:43.221246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=63691cb1f90744c497aaddd6139d5e8c) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:43.221759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:43.224345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.225702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82827e4-02a1-4abf-ba3b-5a253171656c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:43.233964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 376/713] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/role_assignments?user.id=63691cb1f90744c497aaddd6139d5e8c&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:43.268706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:43.269360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:43.269639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:43.269980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:43.270584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:43.272032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:43.284370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:43.285492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:43.286619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 338/714] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:43.293830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:43.332858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:43.412024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:43.415082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da95b9-6ea7-4df9-90ec-1a511d0f41fa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:43.457382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:43.458037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:43.458319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:43.458647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:43.459282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:43.459625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:43.460989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.466098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 377/715] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:43.474328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:43.530367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:43.556363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4a61-9058-4c16-8233-7be28e7692c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:43.616026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:43.627589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:43.629129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:43.629129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:43.629129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:43.629497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:43.631116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.633240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdad6f-7926-4902-b664-b6dac7807c3a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:43.647868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:43.648921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:43.649771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:43.656482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 339/716] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:43.659390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:43.708862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:43.709390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:43.709667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:43.709960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:43.710594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:43.710892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:43.712726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.719518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 378/717] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:43.833390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd59fa-478c-4d78-886a-baff76181aec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:43.885357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:43.885998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:43.886280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:43.886551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:43.887193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:43.887495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:43.888851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17698f-06d7-436b-9e01-9874847e458c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:43.894254 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 340/718] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:43.899855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:44.018149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b1d80-7576-4ae2-92d8-2904cf48f1a3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:44.052546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:44.053555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:44.054167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:44.054692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:44.055585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:44.056092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:44.057672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ac95-0e52-47de-a377-a27e794756f1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:44.064536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 379/719] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 24 09:18:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:44.619583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762e6b-7f6c-445f-8459-3dc616c5c6b2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:44.620109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762e6b-7f6c-445f-8459-3dc616c5c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:44.620109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762e6b-7f6c-445f-8459-3dc616c5c6b2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:44.621770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 341/720] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:44.627729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e1d4-c327-4a7b-a2f4-1e8af2300c08 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:44.628245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e1d4-c327-4a7b-a2f4-1e8af2300c08 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:44.628644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e1d4-c327-4a7b-a2f4-1e8af2300c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:44.659517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6429e1d4-c327-4a7b-a2f4-1e8af2300c08 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:44.660708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6429e1d4-c327-4a7b-a2f4-1e8af2300c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:44.682259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:44.747462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 380/721] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:45.268930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762e6b-7f6c-445f-8459-3dc616c5c6b2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:45.285484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:45.406542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762e6b-7f6c-445f-8459-3dc616c5c6b2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:45.418579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117931-53c4-42fa-afbd-55d8e7f0a2c2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:45.419078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117931-53c4-42fa-afbd-55d8e7f0a2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:45.419156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117931-53c4-42fa-afbd-55d8e7f0a2c2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:45.421674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 381/722] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:45.426448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fed9a-ac91-4622-a1cf-e3d31d1add1b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:45.426738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fed9a-ac91-4622-a1cf-e3d31d1add1b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:45.427021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fed9a-ac91-4622-a1cf-e3d31d1add1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:45.446822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-483fed9a-ac91-4622-a1cf-e3d31d1add1b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:45.448010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-483fed9a-ac91-4622-a1cf-e3d31d1add1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:45.463115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:45.464114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:45.464598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:45.465020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:45.498767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:45.504390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:45.505387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:45.510827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 342/723] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:45.517982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:45.550078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 382/724] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:45.653512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:45.692391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813e830-ffcc-48b0-82a5-701ab7d5d19f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:45.740975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:45.741581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:45.741885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:45.742164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:45.742832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:45.743136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:45.744497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068c64-12dc-44be-bd46-e4354853d149 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:45.748054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88660c24-b981-4cb8-b823-fde6cc593055 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:45.748791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88660c24-b981-4cb8-b823-fde6cc593055 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:45.749150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88660c24-b981-4cb8-b823-fde6cc593055 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:45.752399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 383/725] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:45.755784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 343/726] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:45.761279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88660c24-b981-4cb8-b823-fde6cc593055 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:45.763376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:45.763996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:45.764452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:45.783078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:45.784669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:45.902304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 344/727] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:18:45.907399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:45.915494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:45.951910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88660c24-b981-4cb8-b823-fde6cc593055 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:45.978066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.009345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.010337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.010450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.010722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.019533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee222a-05da-4aeb-9ea6-0e46bda58f7e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.022676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.024132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-65df9636-3fc2-473e-a2ef-81482b56e927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:46.040904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:46.041921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:46.042838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:46.042838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:46.042838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:46.042838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 384/728] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:46.043549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23a95c-0831-4bec-9bb7-286d002278c0 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.043744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23a95c-0831-4bec-9bb7-286d002278c0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.044017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23a95c-0831-4bec-9bb7-286d002278c0 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.045897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 385/729] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:46.048047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23a95c-0831-4bec-9bb7-286d002278c0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.075588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5bf05-c4c5-4fc4-8b64-3c8e89afb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.076644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bf05-c4c5-4fc4-8b64-3c8e89afb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.077017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bf05-c4c5-4fc4-8b64-3c8e89afb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.077358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5bf05-c4c5-4fc4-8b64-3c8e89afb9d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.091593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5bf05-c4c5-4fc4-8b64-3c8e89afb9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b1f5bf05-c4c5-4fc4-8b64-3c8e89afb9d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:46.099196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:46.100171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:46.101015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 345/730] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:46.101941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.102791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.103163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.125460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:46.127146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:46.174356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23a95c-0831-4bec-9bb7-286d002278c0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.218997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.219917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.220852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.221272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.221588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 346/731] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:46.222498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:46.222606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.223117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.225026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.240081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.247734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 386/732] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:46.254372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.306244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.352634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df362fc6-19f5-4c23-9fe5-31c1de8bbb6a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.380438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1ea29-75a1-4b6c-9fa3-023deaff4b59 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.387269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.387878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.388167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.388441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.389108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:46.389413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.390821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.404263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 347/733] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:46.404263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.425470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.426694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.427125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.427547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.435851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.437572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:46.450088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:46.451059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:46.451998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:46.456006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 387/734] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:46.457069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.514139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595315-ea69-4644-aea7-ee23022ed3b6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.517469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.535888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.551094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.551739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.552020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.552294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.562926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:46.566622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ab57-480c-46fe-a4e9-b5a19a268734 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:46.567696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:46.568610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:46.569447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 348/735] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:46.570180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.603117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.603671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.603959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.604236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.615472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.616923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:46.630545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:46.631669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:46.632763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:46.632763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:46.632763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:46.632763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 388/736] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:46.632763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.671559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f873aa-8be1-428f-a881-3eb962939c46 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.705954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.706566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.706852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.707130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.707852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:46.708160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.709615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e080aab-3ab3-4b90-a5b0-abc69a42b509 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.727927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 349/737] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:46.729292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bdf68-557b-45b7-a6eb-30a80fa268dd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.729641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bdf68-557b-45b7-a6eb-30a80fa268dd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.729947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bdf68-557b-45b7-a6eb-30a80fa268dd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.731147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 350/738] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:46.731826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bdf68-557b-45b7-a6eb-30a80fa268dd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.737419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d75d1-538c-4352-b254-3edce57bfb68 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.744530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.767991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:46.771025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.771626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.771905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.772177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.772812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.774183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.831971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bdf68-557b-45b7-a6eb-30a80fa268dd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:46.863054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 389/739] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:18:46 2022] POST /identity/v3/services => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:46.863054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.884875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:46.885519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:46.885802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:46.886100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:46.886855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:46.887071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:46.888722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:46.903499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 351/740] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:46.903499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:46.985915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470fe96-9725-44a3-88b0-b2c64df987cf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.010273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.018811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd5fbd-3725-468b-9395-e7d17f02a4d1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.033905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.034916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.036481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.036481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.036481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:47.036730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.038504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76a9db-8743-4e6b-b89c-3639895a77ca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.052262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 390/741] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:47.052716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.053008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.053287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.060959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.061659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.062055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.062391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.071577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:47.072894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:47.096867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.138130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.139601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.146306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 391/742] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:18:47.146968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.257580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d205010-87d5-4cd8-a5e5-98a4b865f296 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.278279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.290681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 352/743] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:46 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:18:47.291867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.303943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.304604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.304970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.305216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.319800 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.321642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:47.340941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:47.342236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:47.343139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:47.343139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:47.343139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:47.343139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 392/744] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:47.343397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.356892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.433300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ae81-3c94-48c9-a0fd-392b20e5c66c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.463062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8e4eb-10b2-4bb2-80cb-2582dc2b1451 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.473507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.474181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.474469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.474751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.482103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.483544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:47.496252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:47.497237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:47.498232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 353/745] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:47.498838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.506180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.506829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.507114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.507393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.520581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.522639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:47.537637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:47.538744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:47.539659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:47.539659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:47.539659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:47.539659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 393/746] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:47.539949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.563176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.605457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.611428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308de6a-5572-44ac-b6d3-17e1921c548f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.647032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.648071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.648486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.648763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.649408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:47.649711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.649988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3717d0-8081-4588-85d3-992d2831853e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.651098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.665224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 354/747] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:47.666112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.689241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.690038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.690432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.690815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.691472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.692834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.763954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 394/748] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:18:47 2022] POST /identity/v3/services => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:47.764797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.773736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b6ce1-868c-4549-bf7d-e907dfac5b7d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.793237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.835954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.836916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.837524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.838077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.839144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:47.839653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.841770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.863778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 355/749] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:47.865009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:47.920382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed207ad-f0cc-4281-974a-95bc1235f4e7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:47.944975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:47.963227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:47.963985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:47.964271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:47.964547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:47.965216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:47.965520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:47.967698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:47.983349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 395/750] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:47.984787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.012497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51434687-52c4-4489-b4d8-fb665d27131f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.058060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.059229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.059661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.060082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.069971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.072230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:48.088980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:48.090146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:48.091327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:48.094036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 356/751] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:48.094983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.103384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c5e1-c65c-4f95-8d44-5b67a6212a88 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.133165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.140168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.141049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.141448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.143226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.205742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.224029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886984c7-4a62-4637-bbda-557dc22f5423 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.230560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.232136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.269013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.269955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.270516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.270937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.279657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.281733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:48.299018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:48.300122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:48.301219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:48.303958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 357/752] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:48.305050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.356457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 396/753] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:18:48.357599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.425181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.441535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827880be-91ac-4bf9-8c17-8092cd122df8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.448407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.470424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a91a-7c12-4faf-91aa-5b5a521e6127 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.487019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.488036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.488856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.489308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.490509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:48.490958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.492514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.520000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.520889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.521375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.521792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.522644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:48.523079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.524736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.524896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 358/754] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:48.525878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.540145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 397/755] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:48.541316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.639059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797058-b6e6-49ec-ab90-95bd325384bb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.675292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bbd77-6adc-437f-a9c9-2722bac0ff94 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.677358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.678896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.678896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.678896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.690348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.692085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.699885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:48.710664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:48.721677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:48.722622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:48.722622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:48.722622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:48.722622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 359/756] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:48.722622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.722904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.722904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.722904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.722904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.734381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.737766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.739390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:48.759550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:48.760658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:48.761576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:48.761576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:48.761576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:48.767999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 398/757] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:48.769027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.841901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442329db-0654-483b-8711-cc8798cb3299 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.879715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.880318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.880601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.880871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.881602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=8c16b4dc236344ffa2ef8cab86d6594e) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:48.881935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.883360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.887648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12440a45-4a89-4070-a0e5-80bbe59dd85f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:48.889082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 360/758] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/role_assignments?user.id=8c16b4dc236344ffa2ef8cab86d6594e&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:48.889783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:48.949377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:48.950912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.951460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.952885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.954257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:48.954872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:48.957444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf254a75-3fe1-4d7d-87ea-4a63c7891741 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:48.971939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:48.982975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 399/759] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:48.983682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2e2a-1041-49f1-b2a4-d0c5cd540bb9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:48.983973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2e2a-1041-49f1-b2a4-d0c5cd540bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:48.984245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c2e2a-1041-49f1-b2a4-d0c5cd540bb9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:48.986376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 400/760] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:48.987211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2e2a-1041-49f1-b2a4-d0c5cd540bb9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.037898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931665d3-6b5b-454e-9d69-cf5ac7989d64 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.069368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:49.080387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.080947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.081232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.085571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.085571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:49.085571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.085571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d7ab7-9c9d-4016-a75c-a5d2199569b7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.098320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 361/761] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:49.104306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.104873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.105475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.126969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:49.128581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:49.131524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c2e2a-1041-49f1-b2a4-d0c5cd540bb9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.177255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.178343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.178649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.178930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.187864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.190681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:49.203037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:49.204007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:49.205545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:49.209839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 401/762] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:49.210858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.212256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 362/763] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:18:49.213624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.273188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:49.317270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35398c4f-b508-4681-836d-0769e9a07b24 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.325677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f4bc8-32c9-479d-8438-dd6702f2fab1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.332021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:49.357424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.358088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.358375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.358651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.365930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.366777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.367429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.367950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.368424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.368936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.369724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:49.370209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.371975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:49.381456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:49.382421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:49.383325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 402/764] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:49.388472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 363/765] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:49.388619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.399003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.559400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac980c-e97b-48d0-96f8-da40fd12ea53 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.582583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e1068-482c-4390-8a39-8228b47a9af5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.597155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:49.607046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.609245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.609245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.609245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.610226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:49.611252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.613746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.620732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.621463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.621958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.622319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.623469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=6eaa26ac68db40ac9a4ebe47b7b5e814) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:49.623980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.626084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.630663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 403/766] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:49.631750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.637095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 364/767] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:49 2022] GET /identity/v3/role_assignments?user.id=6eaa26ac68db40ac9a4ebe47b7b5e814&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:49.640694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.671916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:49.784420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39e77d-d2f6-4cef-8c5f-41d507f8f094 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.851897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.858030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.858030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.858030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] PATH_INFO: `/v3/services/network` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.858030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.858030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:49.863010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023f30a-3ac1-4b73-8902-41a002d69efa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:49.873892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:49.874946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:49.875794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 404/768] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:49 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:49.877503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:49.939476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2c88b-1e7c-44ea-bfe6-cf88d74b519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:49.940150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2c88b-1e7c-44ea-bfe6-cf88d74b519a None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:49.940433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2c88b-1e7c-44ea-bfe6-cf88d74b519a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:49.940710 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2c88b-1e7c-44ea-bfe6-cf88d74b519a None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/63691cb1f90744c497aaddd6139d5e8c/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:49.944930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2c88b-1e7c-44ea-bfe6-cf88d74b519a None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=63691cb1f90744c497aaddd6139d5e8c, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:49.946470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2c88b-1e7c-44ea-bfe6-cf88d74b519a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:50.032223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 365/769] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:49 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/63691cb1f90744c497aaddd6139d5e8c/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:50.034123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b07a9-6a97-4a43-8e6e-f100d9d12f8b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.034411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b07a9-6a97-4a43-8e6e-f100d9d12f8b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.034690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b07a9-6a97-4a43-8e6e-f100d9d12f8b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.036811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 366/770] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:50.039175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:50.051505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed44680-f25c-4070-b65a-1a40fa676e3c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:50.053487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.053778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.057888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.092461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:50.095335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:50.137399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:50.138045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.138328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.138603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.139249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:50.139555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:50.140944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:50.153469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 405/771] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:18:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:50.160543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:50.161630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:50.241387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 367/772] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:18:50.305768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27b5f6-15e8-4f8d-b8b7-8fc5cf155e55 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:50.343454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:50.343993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.344274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.344551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.345205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:50.345508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:50.346890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:50.352317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 406/773] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:18:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:50.357975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:50.466705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4da136-1bb6-4f84-9d72-85bc210c38c4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:50.503559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:50.504174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.504455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.504729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.505435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] RBAC: Adding query filter params (interface=public, service_id=a254e173e7e447b39659f67ec028570f, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:50.505744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:50.507140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:50.515590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 368/774] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:18:50 2022] GET /identity/v3/endpoints?service_id=a254e173e7e447b39659f67ec028570f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:50.527097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:50.559264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:50.606491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:50.642718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:50.654975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e233-a4d5-48a9-baf4-bab5b6ffea4f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:50.707922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:50.708538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.708821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.709568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.710188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:50.711623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:50.720549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 407/775] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:18:50 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:50.742388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40085-f8e5-4669-a9ef-e1469b84d8e2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:50.799049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:50.799718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.800125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.800406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.801017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:50.802450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:50.812222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:50.813273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:50.814920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 369/776] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 24 09:18:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:50.820822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:50.941381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:50.954098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f9786-0540-4766-9c78-8cb92cb45f43 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:50.991863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:50.992488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:50.992766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:50.993039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:50.993687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:50.994023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:50.995399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7577b-6f30-44f5-aced-96d14de8838a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:51.000879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 408/777] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 24 09:18:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:51.006552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:51.044700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065aec-4809-439f-a078-5c56a23e2891 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.045038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065aec-4809-439f-a078-5c56a23e2891 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.045314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065aec-4809-439f-a078-5c56a23e2891 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.047094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 409/778] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:51.053446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.053804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.054179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.072798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:51.074052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:51.130211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:51.145058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d3b6-6fc9-42a9-9bb4-ad1c4eadf3c5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:51.153625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 410/779] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:18:51.218565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:51.219196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.219486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.219927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.220621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:51.220934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:51.222343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:51.228670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 370/780] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 24 09:18:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:51.234710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:51.323339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:51.341595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70425221-0ac7-4d97-8d1d-ca3ef8f7de25 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:51.377296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:51.377934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.378219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.378493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.379198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] RBAC: Adding query filter params (interface=public, service_id=d954a6733034464a86fa0bc3a87f9dcd, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:51.379505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:51.380873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:51.389967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 411/781] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:18:51 2022] GET /identity/v3/endpoints?service_id=d954a6733034464a86fa0bc3a87f9dcd&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:51.395187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:51.566413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440e145-f3e8-4451-92ca-185a53eb6b46 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:51.616586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1498-6796-4133-9cce-08851607715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:51.617206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1498-6796-4133-9cce-08851607715d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.617493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1498-6796-4133-9cce-08851607715d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.617774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b1498-6796-4133-9cce-08851607715d None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.618421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1498-6796-4133-9cce-08851607715d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:51.619920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b1498-6796-4133-9cce-08851607715d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:51.631360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 371/782] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:18:51 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:51.674588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:51.801212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d68ad-2523-46d5-8e28-b6424b1ca3f6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:51.839469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdc4f9-5406-4b3d-b717-393cdb10574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:51.840207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdc4f9-5406-4b3d-b717-393cdb10574a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.840519 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdc4f9-5406-4b3d-b717-393cdb10574a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.840804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdc4f9-5406-4b3d-b717-393cdb10574a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.853729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdc4f9-5406-4b3d-b717-393cdb10574a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-07fdc4f9-5406-4b3d-b717-393cdb10574a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:51.859429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:51.860930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:51.862280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:51.865605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 412/783] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:51.867002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1498-6796-4133-9cce-08851607715d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:51.924906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:51.994292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717a02a-1497-4bf7-b719-4bab13492626 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:51.994592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717a02a-1497-4bf7-b719-4bab13492626 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:51.994845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717a02a-1497-4bf7-b719-4bab13492626 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:51.997086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 413/784] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:52.002934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.003218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.003490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.009637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b1498-6796-4133-9cce-08851607715d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:52.016539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:52.022422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:52.023624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:52.049289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:52.049935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.050287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.051278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.052051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:52.052360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:52.053742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:52.063057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 372/785] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:52.071276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:52.107356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 414/786] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:18:52.181741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:52.198770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b56ddc-09ad-409e-9eee-857b659ec913 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:52.237325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:52.237977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.238261 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.238536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.249407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:52.251634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:52.267169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:52.268185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:52.269440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:52.269440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:52.269440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:52.269440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 373/787] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:52.273915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:52.410680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ef4b-fd55-4bb6-891f-2c81a8005af7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:52.462570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:52.463177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.463455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.463728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.464374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:52.464676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:52.466058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12846-6bd5-43a0-a58d-6d0f0834c436 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:52.468538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:52.481216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 415/788] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:52.487807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:52.538363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8bd7-18fe-4958-9220-da40f9e9e919 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.539130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8bd7-18fe-4958-9220-da40f9e9e919 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.539632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8bd7-18fe-4958-9220-da40f9e9e919 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.542151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 416/789] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:18:52.546151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.546724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.547217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.586976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:52.588638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:52.614643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ca922-9e0d-4acc-bc9d-d6f9c4965fe6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:52.654419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:52.655042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.655318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.656376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.660527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:52.671698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:52.671698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:52.681917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 417/790] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:18:52.681917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:52.695126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:52.696125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:52.697304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 374/791] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:52.706554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:52.846715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb74ee-ac53-4d5d-b014-666cbec4ba02 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:52.912170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:52.912775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:52.913056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:52.913330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:52.914086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:52.914395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:52.916886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:52.922044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1cede-dac3-4e4a-8825-e3d1c300fa79 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:52.953497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 375/792] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 24 09:18:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:52.959980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:52.986266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.006136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.009391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.009391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.009391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.020013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:53.025458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:53.026423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:53.027452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:53.029366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.036370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 418/793] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:53.037671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.074988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1685d-8a92-43f7-a11b-8b9d6da90b01 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.109684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.111078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.111509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.111785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.122718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.124158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:53.138618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:53.139633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:53.140550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:53.140550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:53.140550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:53.144741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 376/794] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:53.145470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.152027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339bf9-b860-4e6d-b4f0-26bec5b8b267 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.193135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b56d35-988b-434c-83aa-20a9c476200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.193891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b56d35-988b-434c-83aa-20a9c476200d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.194040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b56d35-988b-434c-83aa-20a9c476200d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.194264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b56d35-988b-434c-83aa-20a9c476200d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.206361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b56d35-988b-434c-83aa-20a9c476200d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-70b56d35-988b-434c-83aa-20a9c476200d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:53.210957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:53.211897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:53.212742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 419/795] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:53.213450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97ed1-f11c-4831-a192-f61751312ceb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.213450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97ed1-f11c-4831-a192-f61751312ceb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.214149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb97ed1-f11c-4831-a192-f61751312ceb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.217971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 420/796] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:53.217971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97ed1-f11c-4831-a192-f61751312ceb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.264643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090b3b-fe48-4d53-81a7-85a24fef28d2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.269506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.274477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.302772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.303603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.304166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.304486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.305194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:53.305502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.306901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.315652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 377/797] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:53.316447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.330125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb97ed1-f11c-4831-a192-f61751312ceb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.370261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.371202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.371202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.371406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.372015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:53.372311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.373665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6383-c81b-42d5-a509-940e5418babd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.385975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 421/798] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:53.387153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.387436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.387711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.406178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:53.407516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:53.427309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc1556-ba61-44d4-85c6-6ad2ba9616ba None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.465159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.465780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.466094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.466373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.467058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:53.467348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.468709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.477592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 378/799] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:53.478600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.484008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 422/800] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:18:53.485404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.518601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.534270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.599125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03c4b-023a-451e-a1b3-f20e5ba1dca7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.619835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c24c92-0eba-4a19-b504-321f03b9727b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.635792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.636742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.637213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.637666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.652046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.653494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:53.671538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:53.673048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:53.674160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:53.674160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:53.674160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:53.674160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 379/801] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:53.674897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.675384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.676250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.676722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.677452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.687069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.690752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:53.707300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:53.708228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:53.709139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:53.716254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 423/802] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:53.716254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.772980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.792661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875ec5e-b7c8-4ff4-af89-39d90b0ce355 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.836570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:53.842315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0353e-50db-4bda-a432-d718f547d00f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:53.843062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.844122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.846172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.846610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.860555 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.862840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:53.879444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:53.880462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:53.881361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:53.881361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:53.881361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:53.881361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 380/803] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:53.881361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.886790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:53.887472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:53.887760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:53.888037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:53.888693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:53.888999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:53.890402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:53.902419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 424/804] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:53.903233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:53.991662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5897b1-9b2f-4b58-93bc-e6232b91afee None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.013696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bd411-e666-4eb1-ac83-92d9551cd1a8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.026410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.027018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.027307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.027580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.028265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:54.028572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.030017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.031623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.042826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 381/805] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:54.043623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.053109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.053789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.054106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.054370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.054948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.056317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:54.065882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:54.067027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:54.067882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 425/806] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:53 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:54.068689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.091180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.142472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80337407-d6c1-4b86-86da-ce527f8219bf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.168557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da26bde-357f-4814-a6dd-62aaba692ae2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.176416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.177239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.177521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.177796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.178484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:54.178787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.180179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a424f2-e842-4bfe-af44-8370a5512904 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.192054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 382/807] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:54.193076 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccb7d-309f-4b84-a9b7-9d66e0239acb None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.193366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccb7d-309f-4b84-a9b7-9d66e0239acb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.193646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ccb7d-309f-4b84-a9b7-9d66e0239acb None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.197891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 383/808] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:54.197891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ccb7d-309f-4b84-a9b7-9d66e0239acb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.208555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.209509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.209796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.210119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.217140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.218587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:54.230067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:54.231049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 426/809] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:54.232087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.255344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.301243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ccb7d-309f-4b84-a9b7-9d66e0239acb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.315633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.334419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4e01-1d81-4a28-a964-c999c8a2b1bc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.335745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b4a84-8244-4450-8fb6-3297d0865ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.336438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b4a84-8244-4450-8fb6-3297d0865ec9 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.336718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b4a84-8244-4450-8fb6-3297d0865ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.336994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b4a84-8244-4450-8fb6-3297d0865ec9 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/8c16b4dc236344ffa2ef8cab86d6594e/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.338907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b4a84-8244-4450-8fb6-3297d0865ec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=8c16b4dc236344ffa2ef8cab86d6594e, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.340327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b4a84-8244-4450-8fb6-3297d0865ec9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.368617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.369210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.369492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.369763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.370412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:54.370711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.372042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.377192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 427/810] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:54.378065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.411439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 384/811] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:54 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/8c16b4dc236344ffa2ef8cab86d6594e/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:54.412713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.413002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.413282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.435642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:54.440344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:54.489306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3db92-b029-47ef-9c47-d9d78f4ee6f0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.513088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 385/812] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:18:54.513731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.544641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.545294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.545571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.545844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.558640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.561017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.573968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:54.575362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:54.576281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:54.577228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 428/813] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:54.578556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.583117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.637055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c1fe7-ba48-4249-9e42-bff9d71eaf57 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.673901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.674606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.674958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.675303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.676098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:54.676805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.677989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.696706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 386/814] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:54.701752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.709338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a08cd5-33db-42c8-a3e8-d0458c59b2da None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.744822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.745766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.746330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.746837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.747661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:54.748157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.749698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.755758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 429/815] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:54.756895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.809229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e9a28-07d8-4c47-8e09-aae2d5688aee None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.810215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.826954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:54.856028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.856633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.856911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.857181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.857985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:54.858288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.859694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.861468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845a9e7-ae69-46a4-a958-e979a8a15036 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:54.882887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 387/816] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:54.882887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.901512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:54.902218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:54.902518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:54.902815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:54.914944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:54.916641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:54.931127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:54.932148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:54.933092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:54.933092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:54.933092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:54.939133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 430/817] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:54.939133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:54.998598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e12d27-edec-4ee4-8282-56f741b2ffa4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.036578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.037907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.038185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.038455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.039105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.040448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.044408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9967e28-29e3-4c2b-97c2-2af9022f5842 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.067523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.081593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.082304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.082571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.082849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.083427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.084765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:55.093141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:55.094366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:55.095308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 431/818] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 24 09:18:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:55.096208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.167145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 388/819] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:18:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:55.167978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.201127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ccb1b-8655-4d12-9f81-fdaabdbdfb70 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.210748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.254898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.255574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.255858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.256135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.307834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3c8ee-07e7-4c39-92fb-db90ab2c9fbb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.314293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.343202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.343202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.349494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.350281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.351399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.351775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.352531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:55.352937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.354507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.367969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 389/820] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:55.368897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.465709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.476623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 432/821] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:18:55.477725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.494564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81f38-ee2a-453f-b963-dccafc84df65 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.530736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.531594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.532542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.532951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.533708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:55.534109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.535782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.540781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 390/822] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:55.546068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.560216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.581238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a851bb-2714-47ee-bb1f-3fad987a7991 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.618672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.619221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.619497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.619766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.626860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.628287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:55.640140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:55.641017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:55.642436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:55.646075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 433/823] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:55.646909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.656553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf5651-ef41-4e1c-82e8-6fb1daf34c77 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.692473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.693369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.693772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.694086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.702852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.705253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.706706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:55.721221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:55.722191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:55.723095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:55.723095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:55.723095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:55.723095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 391/824] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:55.723095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.761390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fcdd8-aaa3-4d4f-bca1-2f1727f2c4bc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.796638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.797243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.798250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.798769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.799402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:55.799704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.801114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.806439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 434/825] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:55.807212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.811462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.846664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dad626-82d3-4787-a75a-5cec4a9cd9b7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.885985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.886826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.887109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.887386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.888499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:55.888811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.890651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.909418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 392/826] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:55.909418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:55.919350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57f9e1-1584-4c92-87c1-b41abca9762f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:55.958582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:55.959341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:55.959704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:55.960043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:55.960752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:55.961119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:55.962391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:55.962599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:55.979951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 435/827] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:55.979951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:56.017436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5fc5-f1e2-42d9-8c65-dc16293c93ec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:56.043852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:56.052938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:56.053536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.053814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.054111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.054771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:56.056117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:56.085668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba9dad-7580-4ae1-9779-17f4ac1add2f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:56.120629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:56.121281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.121556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.121827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/6eaa26ac68db40ac9a4ebe47b7b5e814/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.142103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 393/828] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:18:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:18:56.142103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:56.142575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=6eaa26ac68db40ac9a4ebe47b7b5e814, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:56.142575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:56.213113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 436/829] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:18:55 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/6eaa26ac68db40ac9a4ebe47b7b5e814/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:18:56.271478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad4cec-a444-4b33-993e-9265ec4ff08d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:56.275581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:56.314683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:56.315704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.316215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.316693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.325115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:56.326629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ddec504b-2055-4b94-aa91-611244aae334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:56.341081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:56.342186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:56.343366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 394/830] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:56.351331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:56.431509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daab848-fa67-44b3-acc7-a84aad8b2aee None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.431754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daab848-fa67-44b3-acc7-a84aad8b2aee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.431987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daab848-fa67-44b3-acc7-a84aad8b2aee None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.433574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 395/831] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:56.439165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.439455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.439735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.458780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:56.459981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:56.470525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555851ad-8d7d-42b9-9e5c-bfb02f522bba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:56.490467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:56.512261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:56.513283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.513843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.514408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.515305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:56.515791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:56.517583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:56.531335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 437/832] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:56.535009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 396/833] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:18:56.542854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:56.642662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:56.649335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b956b4f-a1f7-419a-937d-af6a26b60bc1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:56.684836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:56.685370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.686032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.686317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.687056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=63691cb1f90744c497aaddd6139d5e8c) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:56.687574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:56.689479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:56.696344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 397/834] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:56 2022] GET /identity/v3/role_assignments?user.id=63691cb1f90744c497aaddd6139d5e8c&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:56.823826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:56.937717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1df0b-b5f8-4b32-9f45-2e91dd291abe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:56.974855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:56.975867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:56.976352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:56.976825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:56.987607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:56.993150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:56.994319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:18:56.995171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:56.997823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 438/835] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:57.005909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:57.108517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892a9a3-916b-41f5-8afe-bb3423abb48f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:57.145142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:57.145757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:57.146083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:57.146362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:57.147028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:57.147336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:57.148698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:57.157759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 398/836] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:18:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:57.163364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:57.198569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:57.267831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79952f79-7baa-417e-acd4-23f1f11bf926 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:57.307393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:57.308414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:57.308904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:57.309541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:57.320948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:57.322731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:57.338744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:57.339765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:57.340682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:57.340682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:57.340682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:57.342913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 439/837] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:57.351486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:57.380741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:57.459070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384b4a8-8b39-4abd-95ce-975687e6aaa0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:57.494234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:57.495214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:57.495564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:57.495907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:57.496614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:57.496989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:57.498444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:57.510280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 399/838] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:57.517023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:57.606599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:57.621224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce28571-4062-4c35-a6cd-e25229d0bc92 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:57.655510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:57.656157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:57.656415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:57.657450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:57.665107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:57.666574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:57.678483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:57.679464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:57.680414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 440/839] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:18:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:57.687338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:57.774341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:57.794702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8095a-911d-4ecf-9c55-1ed65e450fea None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:57.838110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:57.838734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:57.839017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:57.839293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:57.840042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:57.840349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:57.841839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:57.866253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 400/840] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 24 09:18:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:57.867923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:57.981580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555859-3bda-4aac-acfc-9a0036f0270a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:58.017695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f816b-c8a1-4b3c-aace-ebfe90aeeb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:58.018715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f816b-c8a1-4b3c-aace-ebfe90aeeb38 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.019195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f816b-c8a1-4b3c-aace-ebfe90aeeb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.019664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f816b-c8a1-4b3c-aace-ebfe90aeeb38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.041680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:58.090700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f816b-c8a1-4b3c-aace-ebfe90aeeb38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:58.092245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f816b-c8a1-4b3c-aace-ebfe90aeeb38 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:58.195995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 441/841] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:18:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:18:58.201925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:58.275915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd41d-b666-4504-98c9-b85b7e0bbba9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.276224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd41d-b666-4504-98c9-b85b7e0bbba9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.276509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd41d-b666-4504-98c9-b85b7e0bbba9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.278092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 442/842] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:58.285756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a961360-0156-44d3-bf2f-56dbdae1afe5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.286382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a961360-0156-44d3-bf2f-56dbdae1afe5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.287280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a961360-0156-44d3-bf2f-56dbdae1afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.311443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7a961360-0156-44d3-bf2f-56dbdae1afe5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:58.311615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc460-ebd9-4e45-9902-a938e8af148f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:58.313649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7a961360-0156-44d3-bf2f-56dbdae1afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:58.351969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:58.352716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.353003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.353392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.360421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:58.360925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:58.365431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:58.366947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0799c0ad-4df2-4c6d-aeee-7a0b00c80b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:58.387776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:58.388704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 401/843] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb01e-beea-493f-bc47-b6825ba3d62a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb01e-beea-493f-bc47-b6825ba3d62a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb01e-beea-493f-bc47-b6825ba3d62a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 402/844] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:58.390339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb01e-beea-493f-bc47-b6825ba3d62a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:58.394753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 443/845] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:18:58.394753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.395007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.395263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.427173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:58.428675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:58.503393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 444/846] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:18:58.524940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb01e-beea-493f-bc47-b6825ba3d62a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:58.560199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:58.561030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.561510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.561986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.563347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:58.563810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:58.565299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:58.577952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 403/847] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:18:58.586337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:58.689480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eeff53-00a6-4e0f-9400-c7dcb0b9d501 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:58.697126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:58.716931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:58.729807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45165314-382d-428c-a693-eabed53970c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:58.730439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165314-382d-428c-a693-eabed53970c4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.731144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165314-382d-428c-a693-eabed53970c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.731763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165314-382d-428c-a693-eabed53970c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.740884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45165314-382d-428c-a693-eabed53970c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:58.742468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45165314-382d-428c-a693-eabed53970c4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-45165314-382d-428c-a693-eabed53970c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:18:58.754456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:58.755351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:58.756246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 445/848] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:58.757190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aca58-491e-4c3b-a01f-81a822b7a5c7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.757289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aca58-491e-4c3b-a01f-81a822b7a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.757535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aca58-491e-4c3b-a01f-81a822b7a5c7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.762043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 446/849] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:18:58.762043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aca58-491e-4c3b-a01f-81a822b7a5c7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:58.781100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:58.837431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbc01e-1f05-4149-a349-026f87480d5d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:58.868336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aca58-491e-4c3b-a01f-81a822b7a5c7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:58.870973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031aaf5-8990-45f4-bc56-75024bb27db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:58.871672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aaf5-8990-45f4-bc56-75024bb27db4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.872017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aaf5-8990-45f4-bc56-75024bb27db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.872376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aaf5-8990-45f4-bc56-75024bb27db4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.882924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031aaf5-8990-45f4-bc56-75024bb27db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5031aaf5-8990-45f4-bc56-75024bb27db4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:18:58.887931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:58.888841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:58.889675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 404/850] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:18:58.890413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.890413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.891516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.902894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:58.903499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:58.903779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:58.904052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:58.904736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:58.905042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:58.906545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:58.909002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:18:58.910212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:18:58.918365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 447/851] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:58.919390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:58.946814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:58.978455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 405/852] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:18:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:18:58.979961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.018319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465924-06ea-4c5d-9f48-fb1978641e27 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.024595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.051841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.052469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.052747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.053018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.053623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.055013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:59.064218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:59.065194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:59.066084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 448/853] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:59.066904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.092164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e03f-aa4d-4e9d-972a-78a136f9e16e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.128671 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.129285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.129566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.129848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.130534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.130840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.132198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.144922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 406/854] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:18:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:59.144922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.162182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.171629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fdff3-c6b3-41db-949d-77540947b8b9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.211336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.212043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.212327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.212606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.213338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=8c16b4dc236344ffa2ef8cab86d6594e) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.213650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.215145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.221779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 449/855] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/role_assignments?user.id=8c16b4dc236344ffa2ef8cab86d6594e&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:59.222610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.264593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d71d9-f8d9-4aba-b30d-5950ec88736c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.266567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.304877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.305500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.305896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.306172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.306830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.307135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.308884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.317939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 407/856] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:59.319291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.345526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86e53-b86c-422b-98d2-80944369a25f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.385226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.385953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.386169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.386436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.398622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.400884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:18:59.416960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:59.418010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:18:59.419740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:18:59.419740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:18:59.419740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:18:59.419740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 450/857] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:59.419740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.429160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.434310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43cca-0158-42da-914e-91aa3d1ef5b3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.471028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.471658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.472171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.472171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.472770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.474149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:59.482776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:59.483724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:59.484706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 408/858] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:59.486339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.518561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.536780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea948f3-f04f-455d-878b-8f47010b9aae None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.572147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.572920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.573305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.573670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.574443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.574853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.576308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.589888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 451/859] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:59.589888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.601904 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cd221-f51e-4ee2-ae82-4a53c977d1ad None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.642334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.643056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.643412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.643803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.644706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.645105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.646818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.665604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 409/860] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:59.667068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.677797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.719682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379ae8e-2c1a-48e0-8182-d829dad7d558 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.758277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.760166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.760166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.760166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.760166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.760482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.762208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.767526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 452/861] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:18:59.773899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.790123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.802130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd882fa-b500-4513-b761-e7732253fdc4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.848377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.849011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.849294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.849568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.860058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.862288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:18:59.880388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:18:59.881384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:18:59.882851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 410/862] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:18:59.889211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:18:59.911495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe9a69-4bae-4eae-b62e-53e0747d4800 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:18:59.948080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:18:59.948983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:18:59.949469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:18:59.949942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:18:59.950835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:18:59.951331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:18:59.953121 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:18:59.955388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:18:59.966176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 453/863] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:00.013993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03690032-68e3-46c0-bf05-76a72dc690ad None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:00.053701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:00.054355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:00.054640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:00.056907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:00.056907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:00.056907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:00.061886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:00.085476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 411/864] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 24 09:18:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:00.087174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:00.197311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382640aa-0ca0-4d66-8af3-8f01c39649ce None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:00.232354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:00.232965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:00.233244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:00.233518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:00.302607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:00.306710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:00.308243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:00.421448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 454/865] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:00.423223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:00.434948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:00.529012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b359537-8c21-42db-a8ff-3b65af712dfc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:00.565385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:00.566398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:00.566910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:00.567395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:00.578958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:00.580635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:00.596337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:00.597356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:00.598314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:00.598314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:00.598314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:00.604360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 412/866] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:00.605942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:00.710184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f382c-875f-43d7-bef4-3eae0133534a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:00.711923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:00.747906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:00.748539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:00.748820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:00.749169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:00.749892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:00.750230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:00.751748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:00.764408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 455/867] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:00.770940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:00.843274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:00.887496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bf9c-2b1c-4ee6-a705-d36e4d76b7db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:00.923714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:00.924666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:00.925147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:00.925642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:00.932505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:00.934149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:00.945844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:00.946746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:00.947665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:00.950257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 413/868] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:00.957885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:01.062041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b97942-6bef-43ad-ac8c-f75bb2676d07 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:01.098082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:01.098615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.098941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.099226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.099921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:01.100226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:01.101656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda719ce-8faf-4ef6-9290-156f46372a0b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:01.115066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 456/869] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:01.120688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:01.213923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dc743-e13e-4ced-ad25-ec21257c7d10 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.214250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dc743-e13e-4ced-ad25-ec21257c7d10 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.214513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dc743-e13e-4ced-ad25-ec21257c7d10 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.216105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 457/870] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:01.222336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c79e-e0d4-4eed-991d-dd2564fb98c3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.222624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c79e-e0d4-4eed-991d-dd2564fb98c3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.222902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c79e-e0d4-4eed-991d-dd2564fb98c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.228820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc34d2-acb1-4a3b-b05b-507b852a411a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:01.242657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b311c79e-e0d4-4eed-991d-dd2564fb98c3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:01.244137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b311c79e-e0d4-4eed-991d-dd2564fb98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:01.255053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:01.260061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:01.275300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:01.276154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.280556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.280556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.280556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=6eaa26ac68db40ac9a4ebe47b7b5e814) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:01.280556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:01.280556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:01.293539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 414/871] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:01 2022] GET /identity/v3/role_assignments?user.id=6eaa26ac68db40ac9a4ebe47b7b5e814&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:01.333156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 458/872] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:01.607023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:01.623723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d26c1-5e14-4752-8def-2b5393a48e95 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.624138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d26c1-5e14-4752-8def-2b5393a48e95 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.624296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d26c1-5e14-4752-8def-2b5393a48e95 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.625999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 459/873] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:01.631255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.631590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.631815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.651171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:01.652363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:01.733975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 460/874] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:01.744883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bcc37-7f58-449b-af0b-81ba8972f52d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:01.781322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:01.782910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.783399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.783893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.784699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:01.786293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:01.795745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:01.796753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:01.798296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:01.799807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 415/875] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:01.806028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:01.904371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:01.917490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe590b-2e88-4aef-82b1-c775084a6051 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:01.954825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:01.955446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:01.955772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:01.956109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:01.956750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:01.957056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:01.958460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:01.963419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 461/876] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:01.969304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:02.025130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:02.029827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:02.085167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cc8a7-4f12-47d8-9aa8-c90398628a35 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:02.121152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:02.121906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:02.122098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:02.122344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:02.123227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:02.123531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:02.124891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15de71-85d2-4745-afe9-a6b17ac970a5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:02.129951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 416/877] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:02.131189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df2fe-5a01-4f7a-9205-73057b604f26 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:02.131585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df2fe-5a01-4f7a-9205-73057b604f26 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:02.131864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05df2fe-5a01-4f7a-9205-73057b604f26 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:02.133204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 417/878] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:02.139072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:02.139444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:02.139636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:02.149074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ff572-dc77-48d9-ba15-485eeecf384c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:02.164238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:02.165491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:02.191433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4197b0d-48f2-4528-be00-0c88b8fc1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:02.192407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197b0d-48f2-4528-be00-0c88b8fc1d5a None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:02.192872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197b0d-48f2-4528-be00-0c88b8fc1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:02.193329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4197b0d-48f2-4528-be00-0c88b8fc1d5a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:02.194370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4197b0d-48f2-4528-be00-0c88b8fc1d5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:02.195844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4197b0d-48f2-4528-be00-0c88b8fc1d5a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:02.249001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 418/879] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:02.276496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 462/880] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:02 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:19:02.533641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:02.580078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:02.642476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6f2f1-f8bd-4ed7-80c1-339d38fcd0da None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:02.683995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d14e6-5640-42e1-be04-3a37b577511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:02.684611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d14e6-5640-42e1-be04-3a37b577511f None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:02.684896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d14e6-5640-42e1-be04-3a37b577511f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:02.685171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d14e6-5640-42e1-be04-3a37b577511f None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:02.685820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d14e6-5640-42e1-be04-3a37b577511f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:02.687221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d14e6-5640-42e1-be04-3a37b577511f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:02.802320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 419/881] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:02 2022] POST /identity/v3/services => generated 269 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:19:03.333471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea747-80d2-41ee-b249-b51d5fb93033 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:03.334043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea747-80d2-41ee-b249-b51d5fb93033 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:03.334043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faea747-80d2-41ee-b249-b51d5fb93033 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:03.335616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 463/882] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:03.341227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:03.341534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:03.341813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:03.361014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:03.362228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:03.440263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 420/883] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:03.755975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea747-80d2-41ee-b249-b51d5fb93033 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:03.759095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:03.871454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faea747-80d2-41ee-b249-b51d5fb93033 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:03.910030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:03.910722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:03.911010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:03.911286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:03.922932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:03.927797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:03.928712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:03.929967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 464/884] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 24 09:19:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:03.935238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:03.961301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:04.072303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bea22-f0e8-4cdc-9b7f-2f2986eaf82b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.132256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.133114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.133539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.134697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.136655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:04.137690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.141482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950790b-7c7a-4ba2-879f-d8e9117bec5a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:04.154632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 421/885] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:19:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:04.162148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.248162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:04.258183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308652f-1f93-45a2-965d-1d540bb2085a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.258810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308652f-1f93-45a2-965d-1d540bb2085a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.259252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308652f-1f93-45a2-965d-1d540bb2085a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.260920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 422/886] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:04.267089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452173-115b-42aa-b7ad-2c6af6145c9c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.267562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452173-115b-42aa-b7ad-2c6af6145c9c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.268043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452173-115b-42aa-b7ad-2c6af6145c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.295362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1d452173-115b-42aa-b7ad-2c6af6145c9c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:04.296956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d452173-115b-42aa-b7ad-2c6af6145c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:04.309751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9dc79-41a7-4576-8c98-762b8367778f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.347209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.347843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.348060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.348321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.358750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.360706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-71665947-c326-4123-9dfd-1b3bc6405827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:04.376439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:04.377536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:04.378447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:04.378447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:04.378447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:04.378447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 465/887] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:04.379141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f861ce-d055-4583-a9a1-6f66e5dbe228 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.379141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f861ce-d055-4583-a9a1-6f66e5dbe228 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.379374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f861ce-d055-4583-a9a1-6f66e5dbe228 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.380687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 466/888] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:04.383529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f861ce-d055-4583-a9a1-6f66e5dbe228 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.383750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 423/889] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:04.391207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.391497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.391776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.415130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:04.416675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:04.430973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:04.494059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 424/890] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:04.515285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f861ce-d055-4583-a9a1-6f66e5dbe228 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.531733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:04.553362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.554339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.554817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.555320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.556173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:04.556740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.559307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:04.571710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 467/891] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:04.580369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.656813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.695340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e4ac-bce8-422e-8be1-2c76be2b7cb5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.737814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.738472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.738753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.739031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.746456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.748004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:04.760010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:04.760987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:04.761936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 425/892] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:19:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:04.767737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.773095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a694a5f-0611-40a6-9b3f-9a1959cb00c6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.780391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:04.812200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.812863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.813173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.813442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.814150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.815474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:04.827649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:04.829252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:04.830126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 468/893] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:19:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:04.835626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.877571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:04.895715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb52d-cfc6-47fb-bfb5-f4906be9deea None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.930212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.930740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.931022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.931294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.932018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:04.932324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.933746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:04.937028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0a2b5-335a-4cbb-bf4c-bf31940fe223 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:04.951465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 426/894] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 24 09:19:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:04.952524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:04.972688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea71f5-ad71-46a8-b0a3-a1de5d287d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:04.973305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea71f5-ad71-46a8-b0a3-a1de5d287d3f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:04.973590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea71f5-ad71-46a8-b0a3-a1de5d287d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:04.973887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea71f5-ad71-46a8-b0a3-a1de5d287d3f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:04.974552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea71f5-ad71-46a8-b0a3-a1de5d287d3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:04.975914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea71f5-ad71-46a8-b0a3-a1de5d287d3f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.013556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.048890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 469/895] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:04 2022] POST /identity/v3/services => generated 241 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:05.050149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d0b7-5fe1-4ef1-bef9-b9721ac422d2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.050435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d0b7-5fe1-4ef1-bef9-b9721ac422d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.050537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7872f69-4b69-4068-9f70-6ef567782815 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.050717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d0b7-5fe1-4ef1-bef9-b9721ac422d2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.051898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 470/896] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:05.052610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d0b7-5fe1-4ef1-bef9-b9721ac422d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.103747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.104997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.105280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.105553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.106617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:05.106937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.108653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733650-de5f-43e8-9741-61e310d77d8c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.118981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 427/897] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:19:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:05.118981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d901-25da-474a-8102-b227279de2f9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.118981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d901-25da-474a-8102-b227279de2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.118981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d901-25da-474a-8102-b227279de2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.136293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6643d901-25da-474a-8102-b227279de2f9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:05.137517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6643d901-25da-474a-8102-b227279de2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:05.175774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.180656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d0b7-5fe1-4ef1-bef9-b9721ac422d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.219446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.220063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.220345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.220617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.225778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 428/898] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:05.226796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d901-25da-474a-8102-b227279de2f9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.288328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.310917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.314183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.336948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d901-25da-474a-8102-b227279de2f9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.377202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.377951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.378308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.378649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.379379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:05.379753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.381236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.386918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 429/899] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:05.394005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.444157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.454218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 471/900] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:05.460062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.530212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259ebde-aaf4-4fa5-a941-55f0d47ed865 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.549002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.566222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.566825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.567108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.567408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.568077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] RBAC: Adding query filter params (interface=public, service_id=27b39668f69247409509c06213edc866, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:05.568386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.569754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.579966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 430/901] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/endpoints?service_id=27b39668f69247409509c06213edc866&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:05.579966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.590732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4920b1-47b0-4906-a7c4-76e5cfc1a446 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.631297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.632102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.632391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.633025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.645802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.647537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:05.664327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:05.665340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:05.672253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:05.672253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:05.672253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:05.672253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 472/902] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:05.672253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.699699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc951a4c-5b49-4a4e-8f6a-678dcd817db6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.722488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.737211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.737987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.738346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.738636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.739238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.740619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:05.750673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:05.751702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:05.752661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 431/903] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:05.753969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.780173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240f2bd-1250-4fdc-8df1-0fd5d2500e55 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.805050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:05.818822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.819692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.821096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.821096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.821096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.822574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.829148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 473/904] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:19:05.830330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.883013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d78b4-88b7-4246-8590-8a5c3b571ebb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.923675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:05.924309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:05.924592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:05.924868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:05.925545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:05.925886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:05.927296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:05.944970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 432/905] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:05.945954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:05.970353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a492d-dbc2-45a6-9f06-bf14dad5b7ba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:05.997432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:06.032518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.033294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.033576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.034208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.034870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:06.035192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.036649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.043847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 474/906] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:06.050913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:06.073401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214a778-b3b6-4217-b0de-713f28459b47 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:06.110317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:06.123124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.124301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.124663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.125641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.134970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.137422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:06.153457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:06.154421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:06.155709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 433/907] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:06.160852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:06.186435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4ca3c-0698-425c-8fee-25eb0beeaa17 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:06.234732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.235590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.236163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.236586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.237918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:06.238675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.240363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.247290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 475/908] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:06.255352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:06.277245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4bee9-e710-4b93-8478-fa388033181a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:06.315346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:06.318302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.319001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.319231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.319471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.320166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:06.320477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.321995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.339981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 434/909] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:06.340877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:06.381020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:06.386357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0501c-9be8-4ca4-9fee-fc56009a7091 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:06.424374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.424992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.425294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.425535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.426291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] RBAC: Adding query filter params (interface=public, service_id=1e754de625c44ad7bf270911543b4903, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:06.426906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.428020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.433899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 476/910] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:19:06 2022] GET /identity/v3/endpoints?service_id=1e754de625c44ad7bf270911543b4903&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:06.440443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:06.476384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1adab-9907-4590-b193-60ba8dd07f6a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:06.513349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.514269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.514718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.515131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.516311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] RBAC: Adding query filter params (role.id=a2f6ad54e09648859d8026b935bc3dbb, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=6eaa26ac68db40ac9a4ebe47b7b5e814) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:06.516762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.518454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad868e52-613a-4329-8eab-a3d2af1c1726 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.524861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 435/911] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:06 2022] GET /identity/v3/role_assignments?user.id=6eaa26ac68db40ac9a4ebe47b7b5e814&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a2f6ad54e09648859d8026b935bc3dbb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:06.571143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad5e2c-8cdd-4e36-81e2-32a2abc42c43 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:06.580407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:06.613364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345e4f-2db8-4fcf-a8c5-e848dec86cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:06.614502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345e4f-2db8-4fcf-a8c5-e848dec86cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:06.614889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345e4f-2db8-4fcf-a8c5-e848dec86cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:06.615265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345e4f-2db8-4fcf-a8c5-e848dec86cd0 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:06.615994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345e4f-2db8-4fcf-a8c5-e848dec86cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:06.617495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345e4f-2db8-4fcf-a8c5-e848dec86cd0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:06.625585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 477/912] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:19:06 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:19:07.043058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b99af2-d3b5-4390-bf42-388738187688 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.043424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b99af2-d3b5-4390-bf42-388738187688 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.043630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b99af2-d3b5-4390-bf42-388738187688 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.045194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 436/913] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:07.051566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.051850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.052125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.070088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:07.071267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:07.143749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 478/914] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:07.412031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b99af2-d3b5-4390-bf42-388738187688 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:07.515631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:07.526953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b99af2-d3b5-4390-bf42-388738187688 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:07.563951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:07.564961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.565457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.565987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.566762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:07.568601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:07.582842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:07.583865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:07.584711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 437/915] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:07.589962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:07.699122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:07.702353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573ebeb-7a3b-47e6-bbcb-84ffb7afdee0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:07.738005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:07.738960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.739405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.739904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.740542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:07.740844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:07.742226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a6c20-b28f-44ad-b068-a10a698f6471 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:07.747526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 479/916] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:07.753098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:07.866413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669980b-e969-4946-bbfd-1737f3a13c53 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:07.902028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:07.902934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.903414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.903859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.904657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:07.905133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:07.906869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:07.908621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923252-5b52-4c80-abef-42ebf8b6e117 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.908905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923252-5b52-4c80-abef-42ebf8b6e117 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.909177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923252-5b52-4c80-abef-42ebf8b6e117 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.910767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 480/917] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:07.916023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 438/918] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:07.920526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:07.921063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:07.922168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:07.924883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:07.941269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:07.942784 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:07.949009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:08.018128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 481/919] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:08.049500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dddb7-ce40-476b-81fa-c760bbe5d23c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:08.094172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:08.094855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.095137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.095417 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.096118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] RBAC: Adding query filter params (interface=public, service_id=6c42bd84ac5e4f369517cb7b62f48f66, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:08.096427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:08.097781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:08.103360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 439/920] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:19:07 2022] GET /identity/v3/endpoints?service_id=6c42bd84ac5e4f369517cb7b62f48f66&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:08.108849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:08.209538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:08.216252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e082f-a443-4445-b00c-556fb3c3add4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:08.251824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:08.252440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.252759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.253032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.253640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:08.255037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:08.261672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 482/921] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:19:08 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:19:08.306083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:08.403068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:08.421720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f85af7-915b-4171-a15d-3aba4ff28cfa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:08.458248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:08.459420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.459855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.460279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.460999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:08.462854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-24116a76-5923-4f2d-bc6b-6fbc3fae3974 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:08.472602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:08.473915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:19:08.475029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:08.477477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 440/922] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:19:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:08.483228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:08.488781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa419ede-e98e-4387-9380-1e2f4ce7c1e9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.489277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa419ede-e98e-4387-9380-1e2f4ce7c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.489705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa419ede-e98e-4387-9380-1e2f4ce7c1e9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.491458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 441/923] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:08.497024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580327-975f-4b39-a146-d693069088b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.497315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580327-975f-4b39-a146-d693069088b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.497911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580327-975f-4b39-a146-d693069088b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.522312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e6580327-975f-4b39-a146-d693069088b9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:08.523772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6580327-975f-4b39-a146-d693069088b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:08.608884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78663d89-5a52-49b4-93b6-fd7630aecf7f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:08.610975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 442/924] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:08.651894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:08.652507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.652787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.653060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.653757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:08.654100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:08.655454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a14f85-cb80-4ee9-9c37-84ab784c964f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:08.661414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 483/925] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:19:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:08.667209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580327-975f-4b39-a146-d693069088b9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:08.686153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbeb37-7e9c-4365-8807-bc042f7d69b0 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.686458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbeb37-7e9c-4365-8807-bc042f7d69b0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.686726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbeb37-7e9c-4365-8807-bc042f7d69b0 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.689305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 484/926] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:08.693389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.693670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.693973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.715013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:08.716381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:08.738428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:08.756141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:08.785880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580327-975f-4b39-a146-d693069088b9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:08.806031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 485/927] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:08.837454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:08.842009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:08.842009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:08.842009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:08.842009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:08.842009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:08.842009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:08.846653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 443/928] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 24 09:19:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:08.852101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:08.913444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:08.962641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad80dd-d033-4a83-a4bb-0851efe9a419 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.002036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.002897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.003574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.003861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.004810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.006200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.044541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac93139-0f1b-4780-8968-bbc40214a414 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.080141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.080768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.081050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.081324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.085902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 486/929] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:19:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:09.092489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.106738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:09.111075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:09.112714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:09.117118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:09.123326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 444/930] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 24 09:19:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:09.124380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.254570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c940875-85ae-4cf3-a61f-7826e559a3bf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.256700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1ed-82f5-4b50-bdc7-c15206f06a21 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.293928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.294384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.294610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.294798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.294976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.295186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.295472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.295625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.295775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.296931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:09.297244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.297720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.298625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.308430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 445/931] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:09.310205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:09.311178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:09.312150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 487/932] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:09.315317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.319906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.385785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:09.422710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:09.432970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2f97b-ab68-4d6a-8679-4f7c2bc613aa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.454746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c150d3d-f385-419e-977f-93810c28c6a5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.481218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.482433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.483224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.484491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.491983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.492600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.492881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.493155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.494002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:09.494127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.495476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.499366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.505687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 488/933] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:09.505843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.506718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:09.527003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:09.528020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:09.528970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:09.528970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:09.528970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:09.535832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 446/934] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:09.536789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.618663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4074-d7ef-4a4d-a461-72fba52057c0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.650431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:09.656888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.657388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.657674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.658034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.670549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:09.670549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.670549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.670549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 489/935] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:09.672180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.679928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b965-3d43-450a-9717-61f17a78a914 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.699181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:09.729942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.731061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.731469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.731822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.732552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:09.732933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.735519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.753932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 447/936] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:09.759708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.793537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de3a2-3221-438a-9680-0024c16cecb4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.844403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.845226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.845599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.846003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.846841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.848219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.893141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb1c51-3b97-461d-9ab9-9231b3224111 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:09.928969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:09.929642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:09.929952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:09.930232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:09.937927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:09.939360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:09.950969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:09.952252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:19:09.953836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:09.957619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 448/937] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:09.958610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:09.974644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 490/938] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:19:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:10.005726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:10.087022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b815f7-0282-4e28-83e7-6c1409f95aa7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:10.134030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:10.135044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.135547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.136023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.136965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:10.137481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:10.139148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980712e-4599-40b8-bca7-cb829d255b79 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:10.159776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 449/939] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 24 09:19:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:10.163379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.222486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:10.273734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bb06-c02c-48f0-8b10-d9d3edc6b823 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:10.292826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1348-2cb4-407d-af41-57c7179c229d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.293163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1348-2cb4-407d-af41-57c7179c229d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.293375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee1348-2cb4-407d-af41-57c7179c229d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.298085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 450/940] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:10.300971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.301286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.301839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.311412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:10.312670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.312979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.313318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.320335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:10.321518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:10.326194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:10.328376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:10.346464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:10.347440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:10.348350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:10.348350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:10.348350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:10.349285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 491/941] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:10.353131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.408640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 451/942] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:10.467330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca4a3-d9ea-4b43-a08b-14787a29f4a8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:10.470740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:10.507269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:10.508390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.508911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.509756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.510658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:10.511182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:10.512832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:10.525893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 492/943] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:10.532532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.553180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:10.638521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c815339-c62b-4a77-bc46-7d1306246ab1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:10.675663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:10.676298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.676631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.676905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.683923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:10.684348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.685354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:10.696911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:10.697935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:10.698846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 452/944] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:10.704188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.799035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113cd9-2334-42ab-910c-4c5b3cba822d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:10.809156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:10.837736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c054000-6de9-48d7-a024-36e8f87b4c92 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:10.842780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:10.844322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.844817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.845293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.846537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:10.848578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:10.860834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:10.865829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:10.866728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 493/945] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:10.869381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.881969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:10.882721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:10.883101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:10.883474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:10.884738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:10.885150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:10.887397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:10.907328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:10.908910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 453/946] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:10.910924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:10.989051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14581af1-29fc-4fec-aa34-c0c39b0fefc4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:11.013809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1b53-4d6a-41d0-812b-8bba5a343d68 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:11.027945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:11.028970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.029472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.029991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.031538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:11.032478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:11.034123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:11.044235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 494/947] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:11.045438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:11.049901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46269dd2-01f8-40a4-a68d-bfbb8dd4ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:11.050427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269dd2-01f8-40a4-a68d-bfbb8dd4ace8 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.050709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269dd2-01f8-40a4-a68d-bfbb8dd4ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.050983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46269dd2-01f8-40a4-a68d-bfbb8dd4ace8 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/6eaa26ac68db40ac9a4ebe47b7b5e814/roles/a2f6ad54e09648859d8026b935bc3dbb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.053180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269dd2-01f8-40a4-a68d-bfbb8dd4ace8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=6eaa26ac68db40ac9a4ebe47b7b5e814, role_id=a2f6ad54e09648859d8026b935bc3dbb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:11.054643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46269dd2-01f8-40a4-a68d-bfbb8dd4ace8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:11.112824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:11.127077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 454/948] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:19:10 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/6eaa26ac68db40ac9a4ebe47b7b5e814/roles/a2f6ad54e09648859d8026b935bc3dbb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:19:11.128602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62de9-7d9c-4dee-a467-3366a6fcbc1c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.128897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62de9-7d9c-4dee-a467-3366a6fcbc1c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.129241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b62de9-7d9c-4dee-a467-3366a6fcbc1c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.131927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 455/949] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:11.136826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.137432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.138004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.158116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:11.161443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:11.163028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:11.168266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ea216-3345-4743-9fae-adceece7913a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:11.217958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:11.219464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.219742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.220029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.220747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:11.221056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:11.222775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:11.229749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 495/950] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:11.237804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:11.257897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 456/951] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:11.349810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cb9d2-f9d5-4979-b762-20dcc9893a6a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:11.385303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:11.386066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.386439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.386803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.387557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:11.389055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:11.463373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 496/952] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:19:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:11.537386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:11.654601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da0f8-5d3d-4c66-b0f1-3b8e397ac24b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:11.683961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:11.697876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:11.703103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.703103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.703103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.703103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:11.703103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:11.704648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING keystone.server.flask.common [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 09:19:11.747905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.sql.core [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:19:11.747905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:19:11.747905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [parameters: {'id': 'ed61bbf13ee344ca9d838524f5fcf10c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:19:11.747905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed61bbf13ee344ca9d838524f5fcf10c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed61bbf13ee344ca9d838524f5fcf10c. Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:19:11.766119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 09:19:11.767165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application yield resource Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise self.value Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application session.commit() Aug 24 09:19:11.768369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:19:11.769599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:19:11.770746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:19:11.771627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [parameters: {'id': 'ed61bbf13ee344ca9d838524f5fcf10c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:11.772627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:11.773421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed61bbf13ee344ca9d838524f5fcf10c. Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:11.778806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 457/953] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Aug 24 09:19:11 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:11.779522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:11.795572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:11.894604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06667b-848f-4dd9-8cd2-123e95ba1b65 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:11.930360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:11.930988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:11.931265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:11.931536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:11.938343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:11.939779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6501f4ef-dfcc-41d5-853f-317948eba95c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:11.950824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:11.953259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:11.955509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 497/954] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:11.963198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:12.081692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc41a8-46bc-423f-9c94-ea6983ee8e5f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:12.137552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb546c-b6c1-4a87-a945-98b0992cbba6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:12.137552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb546c-b6c1-4a87-a945-98b0992cbba6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:12.137552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb546c-b6c1-4a87-a945-98b0992cbba6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:12.137552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 498/955] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:12.147180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:12.147490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:12.147490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:12.147813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:12.147967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:12.148143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:12.148143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:12.148143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:12.148143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:12.148143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:12.164485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:12.165728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:12.169406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 458/956] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:12.264660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 499/957] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:12.544655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:12.590130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:12.654066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dab1f-ce92-4ada-8253-6221dcc3c1d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:12.694525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:12.695580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:12.696052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:12.696519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:12.697590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:12.700170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:12.710895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:12.712091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:12.712947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 459/958] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:12.720741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:12.725240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:12.846508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f011f-c4b3-4222-a2d2-fc12918c90ac None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:12.883114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:12.883722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:12.883999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:12.884271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:12.884902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:12.885202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:12.886590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31af45-fc91-4da8-92c2-469fe51dfa24 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:12.892123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 500/959] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:12.897358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:13.021261 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0335aa-2dd4-46a1-a4c0-89e97a753268 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:13.023606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:13.058088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:13.058701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.058981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.059257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.059884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:13.060185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:13.061583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8603e6-b09a-4637-8921-934d42cd80d8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:13.066985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 460/960] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:13.195389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82f86-dad1-4ad0-a07b-788a68f867c2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.196120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82f86-dad1-4ad0-a07b-788a68f867c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.196611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82f86-dad1-4ad0-a07b-788a68f867c2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.198581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 501/961] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:13.205705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450d243-abe8-4664-87b7-3180571b74d3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.206054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450d243-abe8-4664-87b7-3180571b74d3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.206281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450d243-abe8-4664-87b7-3180571b74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.225894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a450d243-abe8-4664-87b7-3180571b74d3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:13.227951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a450d243-abe8-4664-87b7-3180571b74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:13.310124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 461/962] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:13.546798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2852-4985-4d1a-8729-2b4c5969c13b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.547209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2852-4985-4d1a-8729-2b4c5969c13b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.547335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2852-4985-4d1a-8729-2b4c5969c13b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.548935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 502/963] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:13.554273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.554730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.554820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.574755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:13.575947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:13.593774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa2852-4985-4d1a-8729-2b4c5969c13b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:13.663340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 462/964] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:13.665605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:13.705286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa2852-4985-4d1a-8729-2b4c5969c13b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:13.741737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:13.742677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.743111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.743537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.754902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:13.759813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:13.760943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:13.762054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:13.764339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 503/965] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 24 09:19:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:13.770975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:13.800592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:13.893169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ae19c-5028-49b2-8d8f-a6617f3ee61c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:13.929422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:13.930119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:13.930412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:13.930690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:13.931364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:13.931672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:13.933093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:13.936326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:13.943077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 463/966] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:19:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:13.949038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.048953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8884-782f-4657-82b6-38ed9915c6c9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.057690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.067631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ecb0-05c7-4f21-abff-8f39c21a5b8b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.078342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.087600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.088416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.088869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.089371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.090209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.091807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:14.101214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:14.102280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:14.103126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:14.103871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.104485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.104593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.104845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.106694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 504/967] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:14.116256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.120055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.121515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:14.138093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:14.139096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:14.140226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:14.140226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:14.140226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:14.140226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 464/968] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:14.144990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.223418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ece6c9-e527-46d3-83dd-2ef64092efa9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.261194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0071b3-989e-4ea6-86bd-4084e441beac None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.265906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.266946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.267300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.267645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.268375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:14.268755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.270292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.277795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 505/969] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:14.285029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.306382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.307171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.307567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.307971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.308637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:14.309016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.310707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.329026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 465/970] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:14.330830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.333787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.347265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.393102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d886e9-2198-4f0f-980b-23c7a6ecd1fd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.432668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.433272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.433551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.433819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.434468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:14.435180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.436538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02738133-a8b5-4622-b57f-f6464a9ce7aa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.442180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 506/971] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:14.443364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c457-0992-4c01-86d1-ed9e17e6a86e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.443654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c457-0992-4c01-86d1-ed9e17e6a86e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.443934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2c457-0992-4c01-86d1-ed9e17e6a86e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.445333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 507/972] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:14.450172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2c457-0992-4c01-86d1-ed9e17e6a86e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.452539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d266a-1275-4ebb-b3fe-2d6be2fcde75 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.489237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.489889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.490177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.490451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.498089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.499575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7a4d92dd-1417-4ff4-b657-490174c1182a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:14.511173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:14.512310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:19:14.513563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:14.517338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 466/973] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:14.518632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.518923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.519199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.538792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:14.539981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:14.565195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2c457-0992-4c01-86d1-ed9e17e6a86e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.585254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.600853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.603747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.604363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.604644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.604926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.605629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] RBAC: Adding query filter params (interface=admin, service_id=6c42bd84ac5e4f369517cb7b62f48f66, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:14.605993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.607384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.612204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 467/974] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:14.617774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 508/975] 10.222.0.60 () {56 vars in 1249 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/endpoints?service_id=6c42bd84ac5e4f369517cb7b62f48f66&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:14.623680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.623806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.729528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadbade-fbda-4419-a191-626de7001883 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.766698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d35cd1-f69c-42c9-a3c1-ad03069e4566 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.767748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.768472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.768762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.769133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.769753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.771142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.786374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 509/976] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:19:14.805213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:14.805869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:14.806179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:14.806464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:14.807210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:14.807520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:14.809138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:14.831007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 468/977] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:14.837013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.891100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:14.900730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:14.956889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ef20-6eb1-4e82-b239-840b3de02ec6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:14.968585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:15.009356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f08f53-63ca-4bcf-a63c-0255182091c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.010110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08f53-63ca-4bcf-a63c-0255182091c2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.010913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08f53-63ca-4bcf-a63c-0255182091c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.011267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08f53-63ca-4bcf-a63c-0255182091c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.033628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d721608-c73f-4c1d-85ac-1ab3e397fc35 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.083708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.084616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.085101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.086082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.086920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.088993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.102362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f08f53-63ca-4bcf-a63c-0255182091c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.104069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f08f53-63ca-4bcf-a63c-0255182091c2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.151691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:15.164822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.sql.core [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:19:15.164822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:19:15.164822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [parameters: {'user_id': 'b1455fba3767490283f56a1c0eed0411', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:19:15.164822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-da08cd47-5484-457e-b8ba-679a4eadf53d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 24 09:19:15.172481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:19:15.179836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application yield resource Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise self.value Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application session.commit() Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:19:15.180790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:19:15.181685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:19:15.188081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:19:15.189267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b1455fba3767490283f56a1c0eed0411', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:15.190343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 09:19:15.191323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 469/978] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 24 09:19:14 2022] POST /identity/v3/users => generated 160 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1717-73cc-4417-a4aa-1f706e10d449 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1717-73cc-4417-a4aa-1f706e10d449 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.192422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1717-73cc-4417-a4aa-1f706e10d449 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.193082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 470/979] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:15.193082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1717-73cc-4417-a4aa-1f706e10d449 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:15.211100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 510/980] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:19:15.212656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.212861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.213140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.232325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:15.233551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:15.299348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1717-73cc-4417-a4aa-1f706e10d449 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.306877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 511/981] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:15.307644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:15.329105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:15.359154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.360399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.361360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.361875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.372678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.374900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:15.391695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:15.392662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:19:15.393631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:15.397113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 471/982] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:15.397587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:15.400840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:15.442031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ff888-f0fd-4094-bb09-186bd17babf6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.491327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.492386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.492870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.493344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.507751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.510455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.524360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06578c0f-e99a-4101-b4e0-1e870e6b53c5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:15.533029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:15.534225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:15.535347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:15.535347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:15.535347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:15.541543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 512/983] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:15.542482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:15.570513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.571143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.571422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.571695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.572389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:15.572691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.574136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.618197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 472/984] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 24 09:19:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:15.619879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:15.662780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b62bb-e501-4186-9060-8444b6dfc08f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.682273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:15.703040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:15.714538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.716235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.716705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.717131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.718382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:15.718952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.721617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.737964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 513/985] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:15.744749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:15.759622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052631b-5c69-4abe-8f85-f840b99b1c1a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.813198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.813824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.822881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.822881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.822881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.822881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.877969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829fb1-c62b-47c7-98a4-a4f2bb2b0caf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:15.915523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:15.916163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:15.916446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:15.916720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:15.923453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:15.924879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:15.934282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 473/986] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:15 2022] POST /identity/v3/services => generated 242 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:15.936411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:15.938426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:15.939358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 514/987] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:15.945358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:16.051964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:16.070009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6e76-6a51-47e1-bb3e-9969f33fb604 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:16.106352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:16.107203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:16.107645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:16.107918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:16.109483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:16.110004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:16.111453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa8d52-fb74-44b0-be24-6912ef8f46f1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:16.123882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 474/988] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:16.130651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:16.181285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:16.232627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388266-5f10-4458-8d85-12d52d412143 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:16.267301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:16.267909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:16.268189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:16.268464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:16.269201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] RBAC: Adding query filter params (role.id=a2f6ad54e09648859d8026b935bc3dbb, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=6eaa26ac68db40ac9a4ebe47b7b5e814) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:16.269511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:16.270965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a55638-d8da-4615-86fb-ef83d840d5b3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:16.277103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 515/989] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:16 2022] GET /identity/v3/role_assignments?user.id=6eaa26ac68db40ac9a4ebe47b7b5e814&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a2f6ad54e09648859d8026b935bc3dbb => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:16.824867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392c25-8c6b-4855-b88e-6ac7d47dfb9c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:16.825309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392c25-8c6b-4855-b88e-6ac7d47dfb9c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:16.825481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392c25-8c6b-4855-b88e-6ac7d47dfb9c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:16.827694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 475/990] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:16.835607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:16.835894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:16.836173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:16.855194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:16.856361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:16.929882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 516/991] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:17.195170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392c25-8c6b-4855-b88e-6ac7d47dfb9c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:17.301729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392c25-8c6b-4855-b88e-6ac7d47dfb9c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:17.343682 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:17.344740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:17.345255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:17.345760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:17.346852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:17.348334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:17.356937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:17.358560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:17.359509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 476/992] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 24 09:19:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:17.364363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:17.412310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:17.469746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27c96b-4c70-4b04-8f15-8793813a51ad None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:17.504129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:17.504740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:17.505022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:17.505294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:17.505956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:17.506261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:17.507684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:17.517889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 517/993] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:17.518887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:17.532872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:17.624706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10265d5-e68e-4e13-8a08-6cef770c329f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:17.659525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:17.660408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:17.660892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:17.661324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:17.662191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:17.662652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:17.664162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2043f-94b8-483a-b516-0875a3c08b5e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:17.669424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 477/994] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 24 09:19:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:17.675315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:17.778537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0c8a5-0af3-4cc0-af6e-6fa03491d8f2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:17.786342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:17.814010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d0a15-030d-4064-b7aa-0b727d76066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:17.815697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d0a15-030d-4064-b7aa-0b727d76066e None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:17.815993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d0a15-030d-4064-b7aa-0b727d76066e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:17.816266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d0a15-030d-4064-b7aa-0b727d76066e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:17.816933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d0a15-030d-4064-b7aa-0b727d76066e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:17.820604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d0a15-030d-4064-b7aa-0b727d76066e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:17.889704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d05eb-aa39-48f4-b84a-d79da8fb1de1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:17.890605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d05eb-aa39-48f4-b84a-d79da8fb1de1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:17.890605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d05eb-aa39-48f4-b84a-d79da8fb1de1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:17.891734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 478/995] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:17.896964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fea8-04d9-4be4-967f-68d3f04ff425 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:17.897250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fea8-04d9-4be4-967f-68d3f04ff425 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:17.909290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fea8-04d9-4be4-967f-68d3f04ff425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:17.909446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 518/996] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:19:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:17.918170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8156fea8-04d9-4be4-967f-68d3f04ff425 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:17.919763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8156fea8-04d9-4be4-967f-68d3f04ff425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:17.997660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:18.004587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 479/997] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:18.230864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf34194-4595-48e9-8aa4-2b3e368ddceb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.231242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf34194-4595-48e9-8aa4-2b3e368ddceb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.231454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf34194-4595-48e9-8aa4-2b3e368ddceb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.232983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 519/998] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:18.239335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.239626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.239901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.258424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:18.259604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:18.272939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf34194-4595-48e9-8aa4-2b3e368ddceb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.334262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 480/999] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:18.384004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf34194-4595-48e9-8aa4-2b3e368ddceb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:18.420700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:18.421728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.422207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.422683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.423465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:18.425017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:18.434162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:18.435366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:18.436539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:18.438973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 520/1000] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:18.444553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.549679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad91b98-60f0-40bc-bf7f-16e34d139be3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:18.581845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:18.587778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:18.588387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.588664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.588935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.589597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:18.589911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:18.591256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:18.596526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 481/1001] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:18.602153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.606805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.634236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:18.713185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9f2b7-0ea4-4920-85de-57821b1eeb8e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:18.714371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d63425-1319-43b0-bf2b-c0f3fc196a6b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:18.752411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:18.752626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:18.753017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.753125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.753293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.753392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.753554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.753660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.754179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:18.754276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:18.754495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:18.755542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:18.755912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:18.761162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 521/1002] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:18.764564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:18.766106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:18.766952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 482/1003] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:18.769701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.772136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.847484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:18.879852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:18.886926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f1bc-2f75-49a7-870c-6eee1d3867f5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:18.893349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eb478-a1ff-4d85-9d32-433df7676e71 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:18.927005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:18.927615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.927893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.928203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.928866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] RBAC: Adding query filter params (interface=public, service_id=43ff276f62f6470e82afba2c39b72590, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:18.929177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:18.929382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:18.930025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:18.930311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:18.930558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:18.930660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:18.931204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:18.931536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:18.932893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:18.937239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 522/1004] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/endpoints?service_id=43ff276f62f6470e82afba2c39b72590&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:18.943431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 483/1005] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:18.943642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:18.945077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:19.057708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089a82c-8b87-484c-97ff-9bebf344de32 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:19.060807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef943d-724d-468f-b63f-9d9b047abb85 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:19.084750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:19.094266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b0ab9-a03a-4ad8-a1cb-8162bfbeecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:19.096180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0ab9-a03a-4ad8-a1cb-8162bfbeecec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:19.096180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0ab9-a03a-4ad8-a1cb-8162bfbeecec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:19.096180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b0ab9-a03a-4ad8-a1cb-8162bfbeecec None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:19.096841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b0ab9-a03a-4ad8-a1cb-8162bfbeecec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:19.097235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:19.097844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:19.098152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:19.098252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b0ab9-a03a-4ad8-a1cb-8162bfbeecec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:19.098433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:19.099064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] RBAC: Adding query filter params (type=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:19.099373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:19.100718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b255-5210-4567-bd99-2ddddf42e3ee None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:19.111679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 523/1006] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:19:19.111908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 484/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:19.960755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdf97b-7d8a-4849-9c21-517ee1ddc6cc None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:19.961268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdf97b-7d8a-4849-9c21-517ee1ddc6cc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:19.961346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdf97b-7d8a-4849-9c21-517ee1ddc6cc None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:19.962694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 524/1008] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:19.968487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:19.968986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:19.969264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:19.989336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:19.991381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:20.071784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 485/1009] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:20.408588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdf97b-7d8a-4849-9c21-517ee1ddc6cc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:20.432852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:20.513028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdf97b-7d8a-4849-9c21-517ee1ddc6cc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:20.548856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7da7-1dec-48ee-a50e-238c8ab99148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:20.549483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7da7-1dec-48ee-a50e-238c8ab99148 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:20.549759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7da7-1dec-48ee-a50e-238c8ab99148 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:20.550067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7da7-1dec-48ee-a50e-238c8ab99148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:20.551161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7da7-1dec-48ee-a50e-238c8ab99148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:20.552733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7da7-1dec-48ee-a50e-238c8ab99148 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:20.562154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 525/1010] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:20.562312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:20.662821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd715d27-1e72-49cd-8952-e46dc96bfee5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:20.680225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:20.699059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d78a7-6ad1-4a47-9c42-241402b862d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:20.699670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d78a7-6ad1-4a47-9c42-241402b862d1 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:20.700012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d78a7-6ad1-4a47-9c42-241402b862d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:20.700289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d78a7-6ad1-4a47-9c42-241402b862d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:20.701344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d78a7-6ad1-4a47-9c42-241402b862d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:20.702837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d78a7-6ad1-4a47-9c42-241402b862d1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:20.797890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 486/1011] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:20 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:21.101727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd112ef-b27e-46b6-be6e-aebd048ab7f6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.102311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd112ef-b27e-46b6-be6e-aebd048ab7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.102311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd112ef-b27e-46b6-be6e-aebd048ab7f6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.103767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 526/1012] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:21.109344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.109754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.109968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.117132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6b4d1-d1ad-4933-877a-d5aee6312bb7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.117420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6b4d1-d1ad-4933-877a-d5aee6312bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.117697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6b4d1-d1ad-4933-877a-d5aee6312bb7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.119176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 527/1013] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:21.124813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.125096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.125366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.129049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:21.130423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:21.144684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:21.145909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:21.203337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 487/1014] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:21.225915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 528/1015] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:21.473395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:21.496717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:21.519794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:21.571632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:21.576216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7c069-a0ba-4934-8507-ef093f6366b8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:21.605736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec866c-c244-4f77-95c0-407be0b8f5b3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:21.611891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:21.612499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.612777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.613047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.613688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:21.615092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:21.642340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:21.642968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.643246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.643517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.644091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:21.645428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:21.653809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:21.655798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:21.656854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 529/1016] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:21.661308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:21.725249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 488/1017] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:21 2022] POST /identity/v3/services => generated 242 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:21.747570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:21.766409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293bd9d-040c-49ab-892a-3cb9aa091a6c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:21.819821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:21.820993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:21.821536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:21.822259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:21.823643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:21.823955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:21.825374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:21.832522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 530/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:21.841496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:21.965344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabf883-784c-4bce-931c-1c132a277dfa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:22.007452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:22.008425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:22.008905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:22.009415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:22.010298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:22.010818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:22.012430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c43ce2-3859-444d-931b-e9e4e13f8998 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:22.018557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 489/1019] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 24 09:19:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:22.024532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:22.139933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d30b-d5ce-4eb3-b4c9-aa1a5b72575e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:22.180767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef72e-f8c0-4d6f-a62d-44c7952e5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:22.181385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef72e-f8c0-4d6f-a62d-44c7952e5b61 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:22.181671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef72e-f8c0-4d6f-a62d-44c7952e5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:22.181977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef72e-f8c0-4d6f-a62d-44c7952e5b61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:22.182685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef72e-f8c0-4d6f-a62d-44c7952e5b61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:22.184044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef72e-f8c0-4d6f-a62d-44c7952e5b61 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:22.258304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:22.268912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 531/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:19:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:22.812396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419148ec-130f-483d-ac34-f25537303f12 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:22.812935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419148ec-130f-483d-ac34-f25537303f12 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:22.812935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419148ec-130f-483d-ac34-f25537303f12 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:22.816969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 490/1021] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:22.822237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:22.823272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:22.823552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:22.845843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:22.847048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:22.922617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 532/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:23.187883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419148ec-130f-483d-ac34-f25537303f12 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:23.214863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:23.296815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419148ec-130f-483d-ac34-f25537303f12 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:23.331877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec28b20-db3c-4b14-bc1b-27f081b6754a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:23.332871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28b20-db3c-4b14-bc1b-27f081b6754a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:23.333350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28b20-db3c-4b14-bc1b-27f081b6754a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:23.333842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec28b20-db3c-4b14-bc1b-27f081b6754a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:23.335339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec28b20-db3c-4b14-bc1b-27f081b6754a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:23.336953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec28b20-db3c-4b14-bc1b-27f081b6754a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:23.340011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 491/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:23.345098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:23.447458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7fb68-7e52-4072-8d9e-5521782b6edd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:23.476040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:23.485883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb58275-fdb6-48bc-aac0-e5cbe235880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:23.486595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58275-fdb6-48bc-aac0-e5cbe235880b None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:23.486875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58275-fdb6-48bc-aac0-e5cbe235880b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:23.487146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58275-fdb6-48bc-aac0-e5cbe235880b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:23.487788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb58275-fdb6-48bc-aac0-e5cbe235880b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:23.489211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb58275-fdb6-48bc-aac0-e5cbe235880b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:23.600370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 533/1024] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:19:23 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:23.728962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06265f33-17c8-427a-ba93-370155522009 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:23.729338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06265f33-17c8-427a-ba93-370155522009 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:23.729521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06265f33-17c8-427a-ba93-370155522009 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:23.731030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 492/1025] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:23.737189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:23.737480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:23.737756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:23.756717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:23.757923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:23.835011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 534/1026] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:24.109265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06265f33-17c8-427a-ba93-370155522009 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.204431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:24.214987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06265f33-17c8-427a-ba93-370155522009 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:24.249517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:24.250284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.250565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.250833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.251408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:24.252756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b9aee28c-161b-40d0-b300-2c03588f3fdc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:24.261187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:24.262388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:24.263244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:24.265951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 493/1027] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:24.269472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.298098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d9649-dbe1-4e76-a69c-401ab877661c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.298382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d9649-dbe1-4e76-a69c-401ab877661c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.298662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d9649-dbe1-4e76-a69c-401ab877661c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.300112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 494/1028] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:24.304847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.305136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.305408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.323097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:24.324284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:24.376576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afec6a-b8a3-4e38-a8df-987986e91c7f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:24.393776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:24.397999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 495/1029] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:24.415112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:24.415830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.416194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.416533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.417227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:24.417592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:24.419057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:24.428521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 535/1030] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:24.430090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.515331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:24.531313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b90268-e4db-4618-a32c-80a728a215f0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:24.564534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:24.565141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.565423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.565703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.566373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] RBAC: Adding query filter params (type=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:24.566678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:24.568034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:24.572983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 496/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:24.579745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.668699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.685190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d9828-3e9b-4f25-b87a-1a3e7b9552d2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:24.722986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:24.723596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.723877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.724150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.724878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] RBAC: Adding query filter params (interface=public, service_id=fde21f8aa55c4eecbdf8db2e094f74e0, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:24.725424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:24.726716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:24.731750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 536/1032] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/endpoints?service_id=fde21f8aa55c4eecbdf8db2e094f74e0&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:24.738116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.776843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385dc70d-d3a1-40e1-84c0-d08b4d7c06eb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:24.786231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:24.815423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:24.816056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.816337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.817235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.834534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:24.840155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:24.841105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:24.842003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:24.846017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 497/1033] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:24.847764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:24.853273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca680430-222b-4dcc-98ac-4a3454963d4a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:24.860505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:24.887544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:24.888152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:24.888434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:24.888797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:24.889453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:24.890849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:24.897333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 537/1034] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:19:24.973220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7165-60f4-401d-a5df-70fac2da4883 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:25.010838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:25.011445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.011724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.012000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.012668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:25.012971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:25.014612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:25.028557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 498/1035] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:19:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:25.030984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:25.136970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5441e-d932-4afb-a95b-affad1a5e47f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:25.139536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:25.174163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:25.174796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.175076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.175350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.187225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:25.188672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:25.204426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:25.205419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:25.206994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:25.206994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:25.206994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:25.206994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 538/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:25.211646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:25.283880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:25.315698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ebcae-b1a9-42d9-b535-eff4ab8f941a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:25.351898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:25.352442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.352728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.353005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.353655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:25.353990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:25.355356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:25.368087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 499/1037] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:25.373504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:25.477941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51565cc8-62b2-49c2-94a5-d74c730743a3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:25.513502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:25.514922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.515414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.515901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.529350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:25.532521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d8355b61-c2e0-4609-8135-10676afa2f8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:25.544109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:25.545078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:25.551498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 539/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:19:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:25.553676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:25.602012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238507-66fa-4c87-99aa-c8a62fe4f718 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.602360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238507-66fa-4c87-99aa-c8a62fe4f718 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.602586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238507-66fa-4c87-99aa-c8a62fe4f718 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.603911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 540/1039] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:25.609241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.609525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.609795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.627691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:25.628895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:25.644524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:25.662248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fff76-b75f-434d-8b92-6cea433eb743 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:25.692336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:25.698446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:25.702877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.702877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.702877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.702877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:25.702877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:25.702877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:25.704950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 541/1040] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:25.729811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 500/1041] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:19:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:25.731070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:25.841060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa4cbb-b244-4aa7-b482-b0ac1afbb5ea None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:25.876822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:25.877437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:25.877712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:25.878008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:25.895081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:25.949023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:25.950512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:25.973351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.065375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 542/1042] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:26.070804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.086013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd01e4c-5f37-4440-ae88-c1b4cfb22434 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.120820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.124033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.124706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.124987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.125263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.136739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:26.143027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:26.146449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:26.147297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 501/1043] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:26.150689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.186709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650347a-9546-4542-ae5e-6272096c559f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.204416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.225024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.226162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.226535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.226805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.240151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.242112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:26.258644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:26.259649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:26.260564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:26.260564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:26.260564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:26.260564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 543/1044] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:26.265367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.266542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a338-cf8d-47b7-aa30-0621511c7845 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.305125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.305748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.306055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.306332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.307077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:26.307386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.308777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.317897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 502/1045] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:26.323365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.377281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.381513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3c88e-acb6-4b8b-aa70-4b0fd9fc11cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.419311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.419932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.420332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.421116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.421842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:26.422179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.423558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.435364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 544/1046] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:26.442934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.446010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556776-d53d-4ed2-a554-b9f6d3c34501 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.458364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.483697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.484334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.484611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.485188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] PATH_INFO: `/v3/users/d9385583def94b3ca2a53582341a98cb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.502514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] RBAC: Authorizing `identity:get_user(user_id=d9385583def94b3ca2a53582341a98cb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.503958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.510406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 503/1047] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/users/d9385583def94b3ca2a53582341a98cb => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:26.511354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.575296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1bd0-fc78-491d-96fa-e3a89d3e884a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.613453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.614154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.614592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.614868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.621754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.623204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.626686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85189d-42ba-4f8c-a5a7-91ae340b0a9a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:26.635236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:26.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:26.637144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 545/1048] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:26.642381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.663035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.667052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.667922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.668204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.668537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.715129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.749313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37970d4-ba53-4b0c-8568-81d0cbfc6419 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.755150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.756600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.789001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.789613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.789918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.790195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.790883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:26.791187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.792606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.814766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 546/1049] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:26.816000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.885764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 504/1050] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:19:26.891517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:26.914791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.945119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a158-343c-4c1f-8b2c-45f57b937e10 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:26.961723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:26.980137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:26.980768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.981052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.981331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.982118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] RBAC: Adding query filter params (role.id=a2f6ad54e09648859d8026b935bc3dbb, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=63691cb1f90744c497aaddd6139d5e8c) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:26.982452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:26.984582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa729-166b-41ea-b5ff-4ae881f5a2d8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:26.989949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 547/1051] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/role_assignments?user.id=63691cb1f90744c497aaddd6139d5e8c&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a2f6ad54e09648859d8026b935bc3dbb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:26.995337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74a8b-1620-4581-824d-73f3f699c795 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:26.995626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74a8b-1620-4581-824d-73f3f699c795 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:26.995906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc74a8b-1620-4581-824d-73f3f699c795 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:26.997242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 548/1052] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:27.001011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106543ec-9681-42a2-9008-bb9a674c400c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:27.003612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:27.003991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:27.005280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:27.026267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:27.027480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:27.041261 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:27.042101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:27.042504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:27.042882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:27.044238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] RBAC: Authorizing `identity:get_project(project_id=470606cfeba7493190dcc59792e0ff27)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:27.046448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:27.053897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 505/1053] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:26 2022] GET /identity/v3/projects/470606cfeba7493190dcc59792e0ff27 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:27.055460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:27.128561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 549/1054] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:27.180121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4b770-d948-4f9a-8c4a-e7a80d1dc17c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:27.219226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:27.219921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:27.220271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:27.220613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:27.221408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=470606cfeba7493190dcc59792e0ff27, user.id=d9385583def94b3ca2a53582341a98cb) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:27.221785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:27.223299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:27.226925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:27.237884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 506/1055] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:27 2022] GET /identity/v3/role_assignments?user.id=d9385583def94b3ca2a53582341a98cb&scope.project.id=470606cfeba7493190dcc59792e0ff27&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:27.406285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:27.477783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:27.508656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475871c5-96eb-4ea6-9a3b-6d74938d95f0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:27.542751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:27.543387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:27.543668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:27.543938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] PATH_INFO: `/v3/services/image` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:27.544509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:27.546754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:27.555507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:27.556487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:27.557354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 550/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 24 09:19:27 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:27.562666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:27.664083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb60cd-7e1b-4068-9e87-0ad3e343d269 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:27.699492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:27.700124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:27.700412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:27.700933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:27.701665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:27.702010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:27.703366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:27.708342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 507/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:27.713901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:27.815029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b540e-7b59-4a79-a98a-d27a18113a7b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:27.859585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:27.860247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:27.860531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:27.860804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:27.861434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] RBAC: Adding query filter params (type=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:27.861739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:27.863144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138718b-ea33-40f5-8fd5-76c969cb4f23 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:27.865373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:27.873886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 551/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:27.875095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:27.939450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:27.978350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48699c-cd84-496c-aba1-d913cb3baaaf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:28.012624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a25bd-d6a7-4434-97c1-e26ca3ecff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:28.013225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a25bd-d6a7-4434-97c1-e26ca3ecff45 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:28.013502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a25bd-d6a7-4434-97c1-e26ca3ecff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:28.013793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a25bd-d6a7-4434-97c1-e26ca3ecff45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:28.014769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a25bd-d6a7-4434-97c1-e26ca3ecff45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:28.016117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a25bd-d6a7-4434-97c1-e26ca3ecff45 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:28.137970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 508/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:19:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:28.957064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc337ab-94d5-495a-ad7a-41636e77a218 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:28.957580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc337ab-94d5-495a-ad7a-41636e77a218 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:28.957657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc337ab-94d5-495a-ad7a-41636e77a218 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:28.959142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 552/1060] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:28.964151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ec54b-aa60-4eb5-969d-d21ece38f8ee None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:28.964573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ec54b-aa60-4eb5-969d-d21ece38f8ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:28.964751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ec54b-aa60-4eb5-969d-d21ece38f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:28.983322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7d7ec54b-aa60-4eb5-969d-d21ece38f8ee None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:28.984517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d7ec54b-aa60-4eb5-969d-d21ece38f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:29.060351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 509/1061] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:29.164988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40906e31-42f9-47e2-b750-6aacfa1f3e59 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.165281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40906e31-42f9-47e2-b750-6aacfa1f3e59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.165469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40906e31-42f9-47e2-b750-6aacfa1f3e59 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.166958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 553/1062] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:29.173181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.173483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.173763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.192229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:29.193458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:29.237001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:29.265045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 510/1063] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:29.329273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40906e31-42f9-47e2-b750-6aacfa1f3e59 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.429635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40906e31-42f9-47e2-b750-6aacfa1f3e59 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.464103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:29.464731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.465010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.465283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.475225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:29.479875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:29.480804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:29.481656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:29.486120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 554/1064] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:29.487329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.532109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.596826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:29.599337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aad3c-f425-442e-ad44-895c88820c43 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.636442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:29.637059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.637341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.637615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.638318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:29.639157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:29.640496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:29.641590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd16de4-7ae4-4478-9293-b60db9777bf1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.653799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 511/1065] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:29.655259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.678197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:29.678831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.679131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.679390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.689899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:29.694972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:29.695976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:29.696809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 555/1066] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:29.698204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:29.703185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.761689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f127c35-7364-4cab-ac34-448ec9f9807d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.798580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:29.799312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.799668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.800015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.807795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5cd27-bff4-4192-8e51-57d762807b31 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.812868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:29.812868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:29.829663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:29.830663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:29.832203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:29.832203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:29.832203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:29.832203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 512/1067] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:29.833947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:29.837112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.849579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:29.850221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.850500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.850772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.851437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:29.851737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:29.853138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:29.862568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 556/1068] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:29.868720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:29.944476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:29.954250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878686b-c32d-4b5e-94cb-53b36d31f4c5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.975282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d3f4e-1f67-4eba-8314-c282d5f6827c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:29.991846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:29.992437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:29.992717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:29.992993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:29.993637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:29.993977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:29.995360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.006972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 513/1069] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:30.012502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.018475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.019113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.019392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.019663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] PATH_INFO: `/v3/users/d9385583def94b3ca2a53582341a98cb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.020794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] RBAC: Authorizing `identity:get_user(user_id=d9385583def94b3ca2a53582341a98cb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.022277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.023846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 557/1070] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:29 2022] GET /identity/v3/users/d9385583def94b3ca2a53582341a98cb => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:30.029465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.082579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.127796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888f059-e361-48dc-8b00-e06e692afd37 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.136634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f618e-4fd5-4ffb-8701-3abff211cf3e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.161397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.162062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.162347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.162620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.169612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce66654-7db3-41dc-90d4-8b1c74e4b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.170027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.170301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66654-7db3-41dc-90d4-8b1c74e4b612 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.170662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66654-7db3-41dc-90d4-8b1c74e4b612 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.170939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce66654-7db3-41dc-90d4-8b1c74e4b612 None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.171393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.172041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce66654-7db3-41dc-90d4-8b1c74e4b612 None admin] RBAC: Authorizing `identity:get_project(project_id=470606cfeba7493190dcc59792e0ff27)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.173436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce66654-7db3-41dc-90d4-8b1c74e4b612 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.175074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 558/1071] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/projects/470606cfeba7493190dcc59792e0ff27 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:30.176175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93a58-bc4a-4d4e-9283-9ff411653348 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.176457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93a58-bc4a-4d4e-9283-9ff411653348 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.176733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93a58-bc4a-4d4e-9283-9ff411653348 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.178074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 559/1072] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7a7c047a-e8d9-4ac6-9c1e-176d7cc01afb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:30.182245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:30.183288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:19:30.184243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:30.184788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf93a58-bc4a-4d4e-9283-9ff411653348 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.184862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 514/1073] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:30.184862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.184862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.185046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.203649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:30.204760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:30.207529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.271647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 515/1074] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:30.272478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.290385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf93a58-bc4a-4d4e-9283-9ff411653348 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.308401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.327186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.327846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.328126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.328433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27/users/d9385583def94b3ca2a53582341a98cb/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.330395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=470606cfeba7493190dcc59792e0ff27, user_id=d9385583def94b3ca2a53582341a98cb, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.331793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.376754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9588eb1-d174-4d41-91a4-ad17a7ed8c4f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.398814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 560/1075] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:19:30 2022] PUT /identity/v3/projects/470606cfeba7493190dcc59792e0ff27/users/d9385583def94b3ca2a53582341a98cb/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:19:30.414584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.415270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.415597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.415923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.416637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:30.416941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.418428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.429124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.442029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 516/1076] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:30.447551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.544900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.566222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84fc50-f2cb-44af-a1f1-c181bcc70d01 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.606628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.607267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.607587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.608022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.619735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.621323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:30.637746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:30.639664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:30.640760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:30.640760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:30.640760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:30.640760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 561/1077] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:30.645777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.658265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd26e93-a925-4a5f-bcd3-191f00c0efad None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.684110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.695517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.698654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.698654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.698654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.759867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e50955-d59a-4ea5-a034-9d497368beca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.769803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.773902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.775506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.798086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.798622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.798900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.799172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.799816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:30.800123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.801755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.813700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 562/1078] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:30.822872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.898262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 517/1079] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:30.903621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:30.928795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:30.940007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86615-3aa5-4bb1-87be-5419b341ea8a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:30.977787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:30.978623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:30.978806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:30.979077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:30.986388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:30.988076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:30.999442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:31.000365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:31.001297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 563/1080] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:31.006196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:31.008754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:31.013737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cf601-bd43-4aee-b01e-686fd54bd2d0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:31.051196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:31.051745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:31.052021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:31.052292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:31.062749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:31.064190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:31.080235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:31.081208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:31.082157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:31.082157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:31.082157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:31.082157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 518/1081] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:31.087052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:31.111419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9f4f-6ed4-4329-a53e-274dbb8d8800 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:31.146940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:31.147546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:31.147831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:31.148092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:31.148775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:31.149077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:31.150516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:31.162870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 564/1082] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:31.168628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:31.182256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:31.193491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703b53-5cd6-4ae7-a51d-2d54bc2eee01 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:31.232163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:31.232823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:31.233222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:31.233505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:31.234178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:31.234517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:31.235847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a1512-5b99-4122-b05d-3d3ca71199ec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:31.247587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 519/1083] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:31.278750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c3ed9-5c55-4c2b-9707-db2b41a707d7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:31.316760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655396-7bf2-4a5f-869e-4a8aa9c3495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:31.317344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655396-7bf2-4a5f-869e-4a8aa9c3495b None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:31.317654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655396-7bf2-4a5f-869e-4a8aa9c3495b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:31.317954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655396-7bf2-4a5f-869e-4a8aa9c3495b None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/63691cb1f90744c497aaddd6139d5e8c/roles/a2f6ad54e09648859d8026b935bc3dbb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:31.320129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655396-7bf2-4a5f-869e-4a8aa9c3495b None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=63691cb1f90744c497aaddd6139d5e8c, role_id=a2f6ad54e09648859d8026b935bc3dbb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:31.321566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655396-7bf2-4a5f-869e-4a8aa9c3495b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:31.395483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 565/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:19:31 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/63691cb1f90744c497aaddd6139d5e8c/roles/a2f6ad54e09648859d8026b935bc3dbb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:19:32.336873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4f46-3971-428a-9043-0dbeb176e169 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:32.337447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4f46-3971-428a-9043-0dbeb176e169 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:32.337540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4f46-3971-428a-9043-0dbeb176e169 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:32.338923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 520/1085] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:32.344261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:32.344659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:32.344832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:32.362831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:32.364009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:32.425896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:32.430533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 566/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:32.697201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda4f46-3971-428a-9043-0dbeb176e169 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:32.711001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:32.799324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda4f46-3971-428a-9043-0dbeb176e169 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:32.835247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:32.835873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:32.836154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:32.836427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:32.848146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:32.852863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:32.854080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:32.854954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:32.858048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 521/1087] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:32.859906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:32.956304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6179381-e61e-42be-8038-4e9f725e5e9e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:32.989511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:32.990198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:32.990479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:32.990753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:32.991409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:32.991708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:32.993062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:33.001592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 567/1088] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:33.007358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:33.075811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:33.106524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f3333-6ef9-4664-b8d2-3a3e27fabe9c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:33.140387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96f80a-37db-4f13-bc79-55a949b9d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:33.141019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96f80a-37db-4f13-bc79-55a949b9d834 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.141305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96f80a-37db-4f13-bc79-55a949b9d834 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.141583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96f80a-37db-4f13-bc79-55a949b9d834 None admin] PATH_INFO: `/v3/users/d9385583def94b3ca2a53582341a98cb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.142736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96f80a-37db-4f13-bc79-55a949b9d834 None admin] RBAC: Authorizing `identity:get_user(user_id=d9385583def94b3ca2a53582341a98cb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:33.144176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96f80a-37db-4f13-bc79-55a949b9d834 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:33.145751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 522/1089] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/users/d9385583def94b3ca2a53582341a98cb => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:33.151627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:33.211799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:33.251074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216145f-0347-4bee-93b9-26d2ecb824b3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:33.283808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:33.284408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.284686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.284957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.298862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51923bd3-eb5b-450d-8cff-fa8ab5988b0f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.299147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51923bd3-eb5b-450d-8cff-fa8ab5988b0f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.299424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51923bd3-eb5b-450d-8cff-fa8ab5988b0f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.300749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 523/1090] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:33.305699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.306031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.306314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.324035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:33.325478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:33.352226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:33.353668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:33.393233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 524/1091] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:33.412855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:33.456306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 568/1092] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:33.457611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:33.521539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:33.553536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb703b6-3789-40c9-8f7c-87256aa841f3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:33.587857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:33.588470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.588747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.589014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.590129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] RBAC: Authorizing `identity:get_project(project_id=470606cfeba7493190dcc59792e0ff27)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:33.591626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:33.593440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 525/1093] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/projects/470606cfeba7493190dcc59792e0ff27 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:33.599567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:33.659671 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:33.698377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee0829-0f30-4b85-95ae-99f8cfe0cd00 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:33.733693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:33.734313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.734596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.734869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.735590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=470606cfeba7493190dcc59792e0ff27, user.id=d9385583def94b3ca2a53582341a98cb) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:33.735893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:33.737307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:33.743003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 569/1094] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/role_assignments?user.id=d9385583def94b3ca2a53582341a98cb&scope.project.id=470606cfeba7493190dcc59792e0ff27&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:33.760231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35663837-0040-4811-a66a-a7360d28e28d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:33.798627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:33.799190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.799474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.799751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.802775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:33.812569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:33.817351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:33.818674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:33.819533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 526/1095] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:33.825706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:33.855614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:33.932454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9c8a2-e8f0-4f7a-a494-dd00c7744bd3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:33.970298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:33.970912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:33.971196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:33.971473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:33.972140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:33.972448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:33.973833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:33.981645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 570/1096] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:33.987649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:34.087679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbb66d-7355-498e-9a1f-452ae61c7111 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:34.120705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:34.121327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:34.121611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:34.121916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:34.132761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:34.134237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:34.147823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:34.148841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:34.149756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:34.149756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:34.149756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:34.149756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 527/1097] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:34.154939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:34.242114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:34.254177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe23af3-8279-48d0-b55f-7ff014995053 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:34.287070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:34.287672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:34.287950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:34.288222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:34.288865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:34.289166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:34.290547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:34.302241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 571/1098] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:34.307813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:34.356297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:34.407665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba144a42-02bb-4b58-9242-843006623c31 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:34.440737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:34.441350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:34.441635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:34.441936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:34.449071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:34.450824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:19:34.461928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:34.463046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:34.464064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 528/1099] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 24 09:19:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:34.468812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:34.564374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c52069-c37b-42b6-aded-cb5faea47254 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:34.596925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:34.597517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:34.597796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:34.598093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:34.598810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:34.599111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:34.600515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:34.617196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 572/1100] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 24 09:19:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:34.623551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:34.721546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1facd0-f1bc-499b-9cb1-f35618c46da7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:34.730312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:34.754551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:34.755155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:34.755435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:34.755707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:34.827785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:34.829238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:34.933200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 529/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:34.938925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:34.947602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:35.037145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ede6-828c-45ec-a0f3-aaa4d54716e6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:35.069036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:35.069653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.069971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.070251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.081141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:35.082603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:19:35.096718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:35.097724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:19:35.099114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:19:35.099114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:19:35.099114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:35.099114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 573/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:35.103526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:35.113850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:35.203148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78498d3a-cd4b-45e4-8e64-2d9bb4b5cc87 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:35.236051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:35.236649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.236929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.237200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.237849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:35.238180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:35.239591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:35.251320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 530/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:35.256902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:35.313943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:35.354809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac52d12-9bb8-4531-b20e-a63cf4ea274a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:35.387304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:35.387928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.388236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.389029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.395434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:35.396864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:19:35.407851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:35.408906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:35.409814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 574/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:19:35.414887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:35.482739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:35.520780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb64dd6-9d68-4df0-a4f9-03ed085e9321 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:35.556880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:35.557481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.557812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.558118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.558801 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:35.559103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:35.561226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebcfd8-e259-4fb0-bd10-ed709bb932d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:35.573074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 531/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:35.579557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:35.676481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa56889-cb91-48bc-9959-eba4d9e5ded0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:35.693320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:35.698096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050423a6-340e-463b-93b1-ac84a813cd8d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.698386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050423a6-340e-463b-93b1-ac84a813cd8d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.698666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050423a6-340e-463b-93b1-ac84a813cd8d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.700304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 532/1106] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:19:35.705749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.706063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.706343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.711391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:35.712023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:35.712341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:35.712619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:35.713351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] RBAC: Adding query filter params (role.id=a2f6ad54e09648859d8026b935bc3dbb, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=63691cb1f90744c497aaddd6139d5e8c) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:35.713662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:35.715111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:35.725903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 575/1107] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:35 2022] GET /identity/v3/role_assignments?user.id=63691cb1f90744c497aaddd6139d5e8c&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a2f6ad54e09648859d8026b935bc3dbb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:19:35.726078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:35.726078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:35.797760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 533/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:36.064487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:36.168922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c30f4-28a3-4165-92b8-fc2121842a2c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:36.203435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffa9cf-a8e8-4512-8a1b-04be29635de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:36.204066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffa9cf-a8e8-4512-8a1b-04be29635de3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:36.204344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffa9cf-a8e8-4512-8a1b-04be29635de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:36.204614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffa9cf-a8e8-4512-8a1b-04be29635de3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:36.205723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffa9cf-a8e8-4512-8a1b-04be29635de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:36.207263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffa9cf-a8e8-4512-8a1b-04be29635de3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:36.208808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 576/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:36.214676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:36.276532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:36.319674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a5b1-edec-443f-b0e3-d19e28b0105e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:36.354649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc977a-703c-42b0-9c6c-20548b42f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:36.355262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc977a-703c-42b0-9c6c-20548b42f505 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:36.355550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc977a-703c-42b0-9c6c-20548b42f505 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:36.355824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc977a-703c-42b0-9c6c-20548b42f505 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:36.356510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc977a-703c-42b0-9c6c-20548b42f505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:36.358026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc977a-703c-42b0-9c6c-20548b42f505 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:36.461375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 534/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:19:36 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:38.416572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1e06-2e44-497f-abc8-766501e8e287 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:38.417110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1e06-2e44-497f-abc8-766501e8e287 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:38.417531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1e06-2e44-497f-abc8-766501e8e287 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:38.418895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 577/1111] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:38.424307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:38.424694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:38.424862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:38.443117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:38.444288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:38.509232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 535/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:38.775390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1e06-2e44-497f-abc8-766501e8e287 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:38.833029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:38.883042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1e06-2e44-497f-abc8-766501e8e287 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:38.917188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:38.917930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:38.918216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:38.918490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] PATH_INFO: `/v3/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:38.920449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] RBAC: Authorizing `identity:get_role(role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:38.921803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:38.923174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 578/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:38 2022] GET /identity/v3/roles/402534b8089045d3acf4ac1379844e80 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:38.929117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:38.973834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:39.025523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c66f-3381-4629-8c64-c276f60d4ada None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:39.058477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:39.059170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:39.059461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:39.059932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] PATH_INFO: `/v3/users/f64a2048a4514ea5bbb338d0f2cfd9b7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:39.072998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] RBAC: Authorizing `identity:get_user(user_id=f64a2048a4514ea5bbb338d0f2cfd9b7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:39.075245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:39.076576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 536/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:38 2022] GET /identity/v3/users/f64a2048a4514ea5bbb338d0f2cfd9b7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:39.082686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:39.212514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23470cb-028d-4765-8ace-d0ec69063e25 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:39.229323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:39.246124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:39.246725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:39.247045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:39.247340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:39.312492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:39.313925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:39.409652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 579/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:39.415689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:39.511045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a038-5e93-462d-9192-a78efeb0bbfc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:39.512516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:39.545291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594dd39-ab81-4c67-afed-3190e62f3e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:39.546006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594dd39-ab81-4c67-afed-3190e62f3e17 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:39.546295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594dd39-ab81-4c67-afed-3190e62f3e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:39.546568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594dd39-ab81-4c67-afed-3190e62f3e17 None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:39.547680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594dd39-ab81-4c67-afed-3190e62f3e17 None admin] RBAC: Authorizing `identity:get_project(project_id=470606cfeba7493190dcc59792e0ff27)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:39.549094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594dd39-ab81-4c67-afed-3190e62f3e17 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:39.550720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 537/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:39 2022] GET /identity/v3/projects/470606cfeba7493190dcc59792e0ff27 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:39.556837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:39.574387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:39.652518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e13e-0244-467a-b34b-9904749bf2d5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:39.685996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:39.686587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:39.686864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:39.687133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:39.687845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] RBAC: Adding query filter params (role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=470606cfeba7493190dcc59792e0ff27, user.id=f64a2048a4514ea5bbb338d0f2cfd9b7) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:39.688151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:39.689547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1506-22b4-4811-875c-cb5b203f85e9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:39.694650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 580/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:39 2022] GET /identity/v3/role_assignments?user.id=f64a2048a4514ea5bbb338d0f2cfd9b7&scope.project.id=470606cfeba7493190dcc59792e0ff27&role.id=402534b8089045d3acf4ac1379844e80 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:41.556260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee33b96-c0bd-4e16-a67b-2cc562e3b135 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:41.556820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee33b96-c0bd-4e16-a67b-2cc562e3b135 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:41.556820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee33b96-c0bd-4e16-a67b-2cc562e3b135 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:41.558157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 538/1118] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:41.563381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:41.563765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:41.563941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:41.582882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:41.584134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:41.648045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 581/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:41.916153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee33b96-c0bd-4e16-a67b-2cc562e3b135 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:42.014331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee33b96-c0bd-4e16-a67b-2cc562e3b135 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:42.046276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:42.046885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:42.047160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:42.047429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] PATH_INFO: `/v3/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:42.048793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] RBAC: Authorizing `identity:get_role(role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:42.050169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:42.051446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 539/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:41 2022] GET /identity/v3/roles/402534b8089045d3acf4ac1379844e80 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:42.057333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:42.071472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:42.153978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d63274-63ee-438a-9ec4-c6dc366ee650 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:42.186211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:42.186830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:42.187109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:42.187381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] PATH_INFO: `/v3/users/f64a2048a4514ea5bbb338d0f2cfd9b7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:42.188485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] RBAC: Authorizing `identity:get_user(user_id=f64a2048a4514ea5bbb338d0f2cfd9b7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:42.189918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:42.191464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 582/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:42 2022] GET /identity/v3/users/f64a2048a4514ea5bbb338d0f2cfd9b7 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:42.197119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:42.236547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:42.295522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a7a0-3a9b-477d-b560-cc60ab6efd05 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:42.328679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7a246-a463-4468-a874-24e138e31db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:42.329288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a246-a463-4468-a874-24e138e31db5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:42.329565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a246-a463-4468-a874-24e138e31db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:42.329837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a246-a463-4468-a874-24e138e31db5 None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:42.330948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7a246-a463-4468-a874-24e138e31db5 None admin] RBAC: Authorizing `identity:get_project(project_id=470606cfeba7493190dcc59792e0ff27)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:42.332348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7a246-a463-4468-a874-24e138e31db5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:42.333964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 540/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:42 2022] GET /identity/v3/projects/470606cfeba7493190dcc59792e0ff27 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:42.339764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:42.418082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:42.436171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309077b-9a6a-4289-b3ed-eb5694add712 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:42.469047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12445d-2727-4ee5-95aa-8094c2c70202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:42.469693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12445d-2727-4ee5-95aa-8094c2c70202 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:42.470008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12445d-2727-4ee5-95aa-8094c2c70202 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:42.470287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12445d-2727-4ee5-95aa-8094c2c70202 None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27/users/f64a2048a4514ea5bbb338d0f2cfd9b7/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:42.472398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12445d-2727-4ee5-95aa-8094c2c70202 None admin] RBAC: Authorizing `identity:create_grant(project_id=470606cfeba7493190dcc59792e0ff27, user_id=f64a2048a4514ea5bbb338d0f2cfd9b7, role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:42.473803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12445d-2727-4ee5-95aa-8094c2c70202 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:42.546286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 583/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:19:42 2022] PUT /identity/v3/projects/470606cfeba7493190dcc59792e0ff27/users/f64a2048a4514ea5bbb338d0f2cfd9b7/roles/402534b8089045d3acf4ac1379844e80 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:19:44.427854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04f998-5a16-4ed8-8f0e-8cb296297efd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:44.428402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04f998-5a16-4ed8-8f0e-8cb296297efd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:44.428402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04f998-5a16-4ed8-8f0e-8cb296297efd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:44.429719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 541/1124] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:44.435111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:44.435520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:44.435678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:44.453444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:44.454642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:44.519405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 584/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:44.801193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04f998-5a16-4ed8-8f0e-8cb296297efd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:44.901093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04f998-5a16-4ed8-8f0e-8cb296297efd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:44.909031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:44.935028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:44.935638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:44.935916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:44.936191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] PATH_INFO: `/v3/roles/402534b8089045d3acf4ac1379844e80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:44.937575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] RBAC: Authorizing `identity:get_role(role_id=402534b8089045d3acf4ac1379844e80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:44.938952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:44.940264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 542/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:44 2022] GET /identity/v3/roles/402534b8089045d3acf4ac1379844e80 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:44.946210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:45.013849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:45.042575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d824fc-423c-4826-a9f2-a046a0727ab3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:45.076537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:45.077089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:45.077368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:45.077642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] PATH_INFO: `/v3/users/f64a2048a4514ea5bbb338d0f2cfd9b7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:45.078771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] RBAC: Authorizing `identity:get_user(user_id=f64a2048a4514ea5bbb338d0f2cfd9b7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:45.080221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:45.081756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 585/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:44 2022] GET /identity/v3/users/f64a2048a4514ea5bbb338d0f2cfd9b7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:45.087548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:45.183392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d625f-5428-4107-9251-cf01174106a3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:45.216809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:45.217390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:45.217667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:45.217964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:45.258065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:45.282060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:45.283486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:45.377093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 543/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:45.382961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:45.479820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28384-4621-403a-9c05-23ba98106d87 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:45.513595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e7606-55d2-4e79-a038-7f4f496fcbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:45.514243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e7606-55d2-4e79-a038-7f4f496fcbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:45.514528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e7606-55d2-4e79-a038-7f4f496fcbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:45.514801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e7606-55d2-4e79-a038-7f4f496fcbf3 None admin] PATH_INFO: `/v3/projects/470606cfeba7493190dcc59792e0ff27` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:45.515917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e7606-55d2-4e79-a038-7f4f496fcbf3 None admin] RBAC: Authorizing `identity:get_project(project_id=470606cfeba7493190dcc59792e0ff27)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:45.517329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e7606-55d2-4e79-a038-7f4f496fcbf3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:45.518944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 586/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:45 2022] GET /identity/v3/projects/470606cfeba7493190dcc59792e0ff27 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:45.525092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:45.597712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:45.621596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1dfa9-540e-4947-90fe-4833dd96e4d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:45.655413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:45.655945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:45.656230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:45.656506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:45.657223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] RBAC: Adding query filter params (role.id=402534b8089045d3acf4ac1379844e80, scope.project.id=470606cfeba7493190dcc59792e0ff27, user.id=f64a2048a4514ea5bbb338d0f2cfd9b7) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:45.657533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:45.658990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240973-2a39-464d-8a7d-5d2b587fed6b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:45.664552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 544/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:45 2022] GET /identity/v3/role_assignments?user.id=f64a2048a4514ea5bbb338d0f2cfd9b7&scope.project.id=470606cfeba7493190dcc59792e0ff27&role.id=402534b8089045d3acf4ac1379844e80 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:47.585443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6ff70-e641-4ace-a678-52cc7540dccb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:47.586026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6ff70-e641-4ace-a678-52cc7540dccb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:47.586026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6ff70-e641-4ace-a678-52cc7540dccb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:47.587346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 587/1131] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:47.592767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:47.593199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:47.593312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:47.611581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:47.612746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:47.677128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 545/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:47.944984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6ff70-e641-4ace-a678-52cc7540dccb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:47.954690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:48.044682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6ff70-e641-4ace-a678-52cc7540dccb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:48.077640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a0592-e91c-466e-836a-38f3e7623df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:48.078280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0592-e91c-466e-836a-38f3e7623df5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:48.078560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0592-e91c-466e-836a-38f3e7623df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:48.078834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a0592-e91c-466e-836a-38f3e7623df5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:48.079935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a0592-e91c-466e-836a-38f3e7623df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:48.081354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a0592-e91c-466e-836a-38f3e7623df5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:48.082916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 588/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:48.088748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:48.152569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:48.186312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023ac8-da75-4791-8a7b-2fc923bea179 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:48.220864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816a22f-9c20-4cb1-9508-974c892d517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:48.221477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816a22f-9c20-4cb1-9508-974c892d517f None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:48.221762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816a22f-9c20-4cb1-9508-974c892d517f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:48.222078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816a22f-9c20-4cb1-9508-974c892d517f None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:48.222760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816a22f-9c20-4cb1-9508-974c892d517f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:48.224226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816a22f-9c20-4cb1-9508-974c892d517f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:48.315865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 546/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:19:48 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:50.231347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14527cd0-5f08-4b1d-8000-ea0e115af798 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:50.231915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14527cd0-5f08-4b1d-8000-ea0e115af798 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:50.231915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14527cd0-5f08-4b1d-8000-ea0e115af798 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:50.233224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 589/1135] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:50.238501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:50.238918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:50.239057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:50.257866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:50.259058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:50.323254 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 547/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:50.597269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14527cd0-5f08-4b1d-8000-ea0e115af798 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:50.671527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:50.696579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14527cd0-5f08-4b1d-8000-ea0e115af798 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:50.729352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310fe6-561f-448c-af0a-f034497ef73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:50.729991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310fe6-561f-448c-af0a-f034497ef73e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:50.730269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310fe6-561f-448c-af0a-f034497ef73e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:50.730537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310fe6-561f-448c-af0a-f034497ef73e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:50.732309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310fe6-561f-448c-af0a-f034497ef73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:50.733716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310fe6-561f-448c-af0a-f034497ef73e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:50.735271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 590/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:19:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:50.741309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:50.789508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:50.838778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287664e1-6b3b-4e1e-bef9-9d2e5ce01a35 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:50.875850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf984a-6444-4eb2-b3d5-30020bcf6ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:50.876378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf984a-6444-4eb2-b3d5-30020bcf6ab1 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:50.876654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf984a-6444-4eb2-b3d5-30020bcf6ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:50.876923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf984a-6444-4eb2-b3d5-30020bcf6ab1 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:50.877559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf984a-6444-4eb2-b3d5-30020bcf6ab1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:50.879003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf984a-6444-4eb2-b3d5-30020bcf6ab1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:50.951821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 548/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:19:50 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:19:52.912352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc15d9-0c18-4afb-9985-dec7baef79c4 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:52.912868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc15d9-0c18-4afb-9985-dec7baef79c4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:52.912977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc15d9-0c18-4afb-9985-dec7baef79c4 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:52.914241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 591/1139] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:52.920272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62934e1-2849-45de-9308-90443b06744f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:52.920674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62934e1-2849-45de-9308-90443b06744f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:52.920811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62934e1-2849-45de-9308-90443b06744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:52.938977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f62934e1-2849-45de-9308-90443b06744f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:52.940142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f62934e1-2849-45de-9308-90443b06744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:53.004679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 549/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:53.278757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc15d9-0c18-4afb-9985-dec7baef79c4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:53.383499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc15d9-0c18-4afb-9985-dec7baef79c4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:53.415984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:53.416592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:53.416872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:53.417146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:53.426880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:53.431508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:53.432689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:53.433613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 592/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:53.439049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62934e1-2849-45de-9308-90443b06744f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:53.472524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:53.535959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62934e1-2849-45de-9308-90443b06744f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:53.568854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:53.569442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:53.569788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:53.570082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:53.570729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:53.571028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:53.572366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:53.580444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 550/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:53.586257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:53.589614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:53.684675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb0cd2-deb9-4876-b786-1235634423b1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:53.717291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:53.717935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:53.718212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:53.718480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] PATH_INFO: `/v3/users/10652977437d4b7188b3bc7d853e5071` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:53.732215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] RBAC: Authorizing `identity:get_user(user_id=10652977437d4b7188b3bc7d853e5071)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:53.733636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:53.735219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 593/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:53 2022] GET /identity/v3/users/10652977437d4b7188b3bc7d853e5071 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:53.741099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:53.835277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:53.839026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e18a-a51d-4898-81e8-64e966267188 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:53.873068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:53.873653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:53.873955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:53.874227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:53.940002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:53.941463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:54.039019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:54.044235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 551/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:19:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:19:54.050434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:54.110048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:54.149082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4939-2323-4286-95e1-b1124aabcae9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:54.183038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e52bc-af9b-4ea7-b8cc-c84d013de73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:54.183691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e52bc-af9b-4ea7-b8cc-c84d013de73c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:54.184052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e52bc-af9b-4ea7-b8cc-c84d013de73c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:54.184338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e52bc-af9b-4ea7-b8cc-c84d013de73c None admin] PATH_INFO: `/v3/projects/6e032b48ae6b4534b6e04771c7113e93` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:54.185451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e52bc-af9b-4ea7-b8cc-c84d013de73c None admin] RBAC: Authorizing `identity:get_project(project_id=6e032b48ae6b4534b6e04771c7113e93)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:54.186904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e52bc-af9b-4ea7-b8cc-c84d013de73c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:54.188499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 594/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:54 2022] GET /identity/v3/projects/6e032b48ae6b4534b6e04771c7113e93 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:54.194622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:54.289969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f21d-38f8-4363-b052-38c73ce2daea None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:54.323043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:54.323629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:54.324171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:54.325000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:54.325711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=6e032b48ae6b4534b6e04771c7113e93, user.id=10652977437d4b7188b3bc7d853e5071) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:54.326046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:54.327453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3de7fc-174a-4625-ad39-bbc1f8235d40 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:54.332574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 552/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:19:54 2022] GET /identity/v3/role_assignments?user.id=10652977437d4b7188b3bc7d853e5071&scope.project.id=6e032b48ae6b4534b6e04771c7113e93&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:56.194942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b6eb-e7fd-47b1-bde3-390df674f579 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:56.195445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b6eb-e7fd-47b1-bde3-390df674f579 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:56.195445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b6eb-e7fd-47b1-bde3-390df674f579 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:56.196732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 595/1147] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:56.202911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:56.203333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:56.203441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:56.221181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:56.222383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:56.277473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:56.287550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 553/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:19:56.556477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b6eb-e7fd-47b1-bde3-390df674f579 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:56.654856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b6eb-e7fd-47b1-bde3-390df674f579 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:56.680201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:56.688236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:56.688853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:56.690620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:56.690620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:56.699266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:56.703877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:56.704983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:19:56.706034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 596/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:56.710828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:56.806188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee49d8-1ec3-4161-81bf-7c3c7421ca8c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:56.840777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:56.841380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:56.841663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:56.841963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:56.842626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:56.842929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:56.844288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:56.852143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 554/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:56.858590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:56.956172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418c3f-6c01-4ef2-be20-f965eabd0a31 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:56.988225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:56.988835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:56.989117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:56.989391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] PATH_INFO: `/v3/users/10652977437d4b7188b3bc7d853e5071` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:56.990520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] RBAC: Authorizing `identity:get_user(user_id=10652977437d4b7188b3bc7d853e5071)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:56.991930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:56.993470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 597/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:56 2022] GET /identity/v3/users/10652977437d4b7188b3bc7d853e5071 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:56.999764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:57.054536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:57.098614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2d05c-eafe-419f-a14b-edad1ec4b59d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:57.130695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a6f00-638f-4ecd-b4d0-931d8329ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:57.131305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a6f00-638f-4ecd-b4d0-931d8329ad66 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:57.131588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a6f00-638f-4ecd-b4d0-931d8329ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:57.131862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a6f00-638f-4ecd-b4d0-931d8329ad66 None admin] PATH_INFO: `/v3/projects/6e032b48ae6b4534b6e04771c7113e93` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:57.132959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a6f00-638f-4ecd-b4d0-931d8329ad66 None admin] RBAC: Authorizing `identity:get_project(project_id=6e032b48ae6b4534b6e04771c7113e93)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:57.134410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a6f00-638f-4ecd-b4d0-931d8329ad66 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:57.136007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 555/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:19:56 2022] GET /identity/v3/projects/6e032b48ae6b4534b6e04771c7113e93 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:57.143058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:57.197000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:57.239764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc823d9-2ef9-4b81-ab15-2db7cb0a485e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:57.272667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53ae13-ac0a-4f59-bcec-c972f286b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:57.273313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ae13-ac0a-4f59-bcec-c972f286b0e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:57.273597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ae13-ac0a-4f59-bcec-c972f286b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:57.273894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ae13-ac0a-4f59-bcec-c972f286b0e8 None admin] PATH_INFO: `/v3/projects/6e032b48ae6b4534b6e04771c7113e93/users/10652977437d4b7188b3bc7d853e5071/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:57.275773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53ae13-ac0a-4f59-bcec-c972f286b0e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e032b48ae6b4534b6e04771c7113e93, user_id=10652977437d4b7188b3bc7d853e5071, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:57.277233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53ae13-ac0a-4f59-bcec-c972f286b0e8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:57.362523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 598/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:19:57 2022] PUT /identity/v3/projects/6e032b48ae6b4534b6e04771c7113e93/users/10652977437d4b7188b3bc7d853e5071/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:19:59.241294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db89e5-4b4c-4019-9fb6-7a7fb4e13d2f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:59.241841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db89e5-4b4c-4019-9fb6-7a7fb4e13d2f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:59.241841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db89e5-4b4c-4019-9fb6-7a7fb4e13d2f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:59.243231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 556/1154] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:19:59.249019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:59.249434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:59.249570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:59.267608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:19:59.268777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:19:59.334194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 599/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:19:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:19:59.601939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db89e5-4b4c-4019-9fb6-7a7fb4e13d2f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:59.702170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db89e5-4b4c-4019-9fb6-7a7fb4e13d2f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:59.724363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:59.735554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:59.736172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:59.736449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:59.736719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:59.746620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:19:59.751505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:19:59.752430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:19:59.753469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 557/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:19:59.758757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:19:59.803253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:19:59.856773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f6bf7-cfe8-4b52-b594-355ea49ab130 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:19:59.890160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:19:59.890757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:19:59.891034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:19:59.891303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:19:59.891958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:19:59.892259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:19:59.893612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:19:59.901279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 600/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:19:59.907792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:00.005699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09fa20-57a2-4348-97aa-e80aeeef82e7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:00.039126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:00.039731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:00.040010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:00.040282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] PATH_INFO: `/v3/users/10652977437d4b7188b3bc7d853e5071` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:00.041377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] RBAC: Authorizing `identity:get_user(user_id=10652977437d4b7188b3bc7d853e5071)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:00.042983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:00.044672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 558/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:19:59 2022] GET /identity/v3/users/10652977437d4b7188b3bc7d853e5071 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:00.050557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:00.149110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4b417-92b7-4ca3-9b23-6a00fb7ecad3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:00.157476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:00.180743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:00.181339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:00.181622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:00.181926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:00.247075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:00.248504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:00.341916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 601/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:20:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:00.347832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:00.396576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:00.445198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6fea1-85a8-4b08-bcf0-9aee56d6ae50 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:00.476959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3a59d-702c-4445-a065-d2efbef72291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:00.477573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a59d-702c-4445-a065-d2efbef72291 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:00.477867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a59d-702c-4445-a065-d2efbef72291 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:00.478335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3a59d-702c-4445-a065-d2efbef72291 None admin] PATH_INFO: `/v3/projects/6e032b48ae6b4534b6e04771c7113e93` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:00.479438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3a59d-702c-4445-a065-d2efbef72291 None admin] RBAC: Authorizing `identity:get_project(project_id=6e032b48ae6b4534b6e04771c7113e93)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:00.481401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3a59d-702c-4445-a065-d2efbef72291 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:00.483015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 559/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:20:00 2022] GET /identity/v3/projects/6e032b48ae6b4534b6e04771c7113e93 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:00.489190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:00.499711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:00.586126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d13331-7974-4b23-b372-14d66a3f5824 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:00.619090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:00.619685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:00.619968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:00.620243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:00.621685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=6e032b48ae6b4534b6e04771c7113e93, user.id=10652977437d4b7188b3bc7d853e5071) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:00.622025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:00.623453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b861c7c-bdcf-4136-a861-495b49eedbfe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:00.628964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 602/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:20:00 2022] GET /identity/v3/role_assignments?user.id=10652977437d4b7188b3bc7d853e5071&scope.project.id=6e032b48ae6b4534b6e04771c7113e93&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:20:02.547457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f288bb3-9481-474b-a533-edbf083edb12 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:02.548027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f288bb3-9481-474b-a533-edbf083edb12 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:02.548027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f288bb3-9481-474b-a533-edbf083edb12 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:02.549338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 560/1162] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:02.554518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86830c8b-721d-4739-b105-696072d4d9be None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:02.554889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86830c8b-721d-4739-b105-696072d4d9be None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:02.555088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86830c8b-721d-4739-b105-696072d4d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:02.572659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-86830c8b-721d-4739-b105-696072d4d9be None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:02.574711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-86830c8b-721d-4739-b105-696072d4d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:02.639604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 603/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:20:02.911465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f288bb3-9481-474b-a533-edbf083edb12 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:03.010440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f288bb3-9481-474b-a533-edbf083edb12 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:03.027822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:03.043855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:03.044456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:03.044739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:03.045014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:03.111493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:03.112858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:03.209733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 561/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:20:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:03.215704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86830c8b-721d-4739-b105-696072d4d9be None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:03.217869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:03.312228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86830c8b-721d-4739-b105-696072d4d9be None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:03.345633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:03.346264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:03.346540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:03.346810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:03.353081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:03.354530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cb64f39e-a43f-485b-8142-ad40bc48f4b7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:20:03.365468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:20:03.366694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:20:03.367603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 604/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:20:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:20:03.372524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:03.390832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:03.469274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee18e02-df6c-4024-8e83-6bd8086369f4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:03.501377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:03.501991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:03.502274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:03.502544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:03.503179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:03.503483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:03.504839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885df4-5387-4438-a074-4c5582bd6817 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:03.512239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 562/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 24 09:20:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:05.386936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf23a9-1477-4db5-9c07-13d83883c6a2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:05.387470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf23a9-1477-4db5-9c07-13d83883c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:05.387582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf23a9-1477-4db5-9c07-13d83883c6a2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:05.388904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 605/1167] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:05.394099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c820a9-2a84-43f7-8d6a-31d7d5f9f5b7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:05.394493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c820a9-2a84-43f7-8d6a-31d7d5f9f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:05.394659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c820a9-2a84-43f7-8d6a-31d7d5f9f5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:05.412159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-85c820a9-2a84-43f7-8d6a-31d7d5f9f5b7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:05.413337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-85c820a9-2a84-43f7-8d6a-31d7d5f9f5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:05.477442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 563/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:20:05.747087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf23a9-1477-4db5-9c07-13d83883c6a2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:05.807032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:05.845311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf23a9-1477-4db5-9c07-13d83883c6a2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:05.878257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389428-f7ef-4818-9c32-d6e90f84c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:05.878855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389428-f7ef-4818-9c32-d6e90f84c70f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:05.879135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389428-f7ef-4818-9c32-d6e90f84c70f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:05.879407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389428-f7ef-4818-9c32-d6e90f84c70f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:05.880073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72389428-f7ef-4818-9c32-d6e90f84c70f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:05.881411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72389428-f7ef-4818-9c32-d6e90f84c70f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:05.969375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 606/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Wed Aug 24 09:20:05 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:20:07.907356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20bef-c7fb-45eb-aef9-754d067c57e3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:07.907863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20bef-c7fb-45eb-aef9-754d067c57e3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:07.907949 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20bef-c7fb-45eb-aef9-754d067c57e3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:07.909248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 564/1170] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:07.914606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:07.915033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:07.915165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:07.932722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:07.933936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:07.998283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 607/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:20:08.264975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee20bef-c7fb-45eb-aef9-754d067c57e3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:08.279732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:08.363829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee20bef-c7fb-45eb-aef9-754d067c57e3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:08.397092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421be26-3cb0-4bc3-8663-fac707bd8ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:08.397700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421be26-3cb0-4bc3-8663-fac707bd8ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:08.398007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421be26-3cb0-4bc3-8663-fac707bd8ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:08.398283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421be26-3cb0-4bc3-8663-fac707bd8ce1 None admin] PATH_INFO: `/v3/domains/666f525b2cfb4a648921324f42dec3c3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:08.408517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421be26-3cb0-4bc3-8663-fac707bd8ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=666f525b2cfb4a648921324f42dec3c3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:08.409958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421be26-3cb0-4bc3-8663-fac707bd8ce1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:08.411496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 565/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Aug 24 09:20:08 2022] GET /identity/v3/domains/666f525b2cfb4a648921324f42dec3c3 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:08.417225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:08.468211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:08.513318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bfd7-4e30-44ae-95a0-b593e3b3211a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:08.546984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70a9b5-6173-4663-ac3c-6ab0eac2773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:08.547512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70a9b5-6173-4663-ac3c-6ab0eac2773f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:08.547790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70a9b5-6173-4663-ac3c-6ab0eac2773f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:08.548058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70a9b5-6173-4663-ac3c-6ab0eac2773f None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:08.548689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70a9b5-6173-4663-ac3c-6ab0eac2773f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:08.550129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70a9b5-6173-4663-ac3c-6ab0eac2773f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:08.662690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 608/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:20:08 2022] POST /identity/v3/projects => generated 361 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:20:10.607923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d8f0-7971-433f-8f30-4a41b442e714 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:10.608515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d8f0-7971-433f-8f30-4a41b442e714 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:10.608515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9d8f0-7971-433f-8f30-4a41b442e714 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:10.609803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 566/1174] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:10.614983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:10.615405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:10.615540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:10.633579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:10.634777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:10.699752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 609/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:20:10.969357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d8f0-7971-433f-8f30-4a41b442e714 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:11.038697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:11.069197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9d8f0-7971-433f-8f30-4a41b442e714 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:11.101896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c80f8-1a28-40b4-81f3-2150ea621879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:11.102507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c80f8-1a28-40b4-81f3-2150ea621879 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:11.102789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c80f8-1a28-40b4-81f3-2150ea621879 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:11.103061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c80f8-1a28-40b4-81f3-2150ea621879 None admin] PATH_INFO: `/v3/domains/666f525b2cfb4a648921324f42dec3c3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:11.104166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c80f8-1a28-40b4-81f3-2150ea621879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=666f525b2cfb4a648921324f42dec3c3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:11.106258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c80f8-1a28-40b4-81f3-2150ea621879 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:11.107794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 567/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Aug 24 09:20:10 2022] GET /identity/v3/domains/666f525b2cfb4a648921324f42dec3c3 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:11.113544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:11.147723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:11.214825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07274ea3-e7a7-45e5-aa91-4bc8c1c315ee None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:11.249632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24942b24-e1c0-43de-b56c-7023aa223470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:11.250240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24942b24-e1c0-43de-b56c-7023aa223470 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:11.250536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24942b24-e1c0-43de-b56c-7023aa223470 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:11.250821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24942b24-e1c0-43de-b56c-7023aa223470 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:11.251524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24942b24-e1c0-43de-b56c-7023aa223470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:11.252946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24942b24-e1c0-43de-b56c-7023aa223470 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:11.378569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 610/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:20:11 2022] POST /identity/v3/users => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:20:13.308237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c5d3-266a-49c0-8003-abf11b27ccc7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:13.308796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c5d3-266a-49c0-8003-abf11b27ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:13.308796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5c5d3-266a-49c0-8003-abf11b27ccc7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:13.310152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 568/1178] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:13.315385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:13.315777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:13.315944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:13.333663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:13.334878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:13.398354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 611/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:20:13.667496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5c5d3-266a-49c0-8003-abf11b27ccc7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:13.764350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5c5d3-266a-49c0-8003-abf11b27ccc7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:13.797138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:13.797739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:13.798049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:13.798319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:13.805467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:13.808400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:20:13.812982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:20:13.814197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:20:13.815334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 569/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:20:13.820208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:13.842480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:13.918105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2c746-1561-43c7-aee1-190b5fc02088 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:13.953167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:13.953798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:13.954275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:13.954470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:13.955140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:13.955446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:13.956802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:13.965556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 612/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:13.971365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:14.068849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bcbb5-0cb7-4379-a87b-7db179f5a05b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:14.102200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:14.102810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:14.103090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:14.103363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] PATH_INFO: `/v3/users/b88d4d58d887479b9e85599eedba92f5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:14.115875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] RBAC: Authorizing `identity:get_user(user_id=b88d4d58d887479b9e85599eedba92f5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:14.117291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:14.118874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 570/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:20:13 2022] GET /identity/v3/users/b88d4d58d887479b9e85599eedba92f5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:14.124892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:14.204866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:14.222359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ccad-3b35-4e3d-ae1d-f381dc8633a8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:14.255990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:14.256582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:14.256861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:14.257130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:14.321806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:14.324361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:14.399338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:14.416784 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 613/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:20:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:14.422813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:14.479805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:14.524509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cac702-1a86-4840-98c0-1092cd93247c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:14.556919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969843c7-a5b6-459e-bcfb-fe39004937d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:14.558313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969843c7-a5b6-459e-bcfb-fe39004937d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:14.558599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969843c7-a5b6-459e-bcfb-fe39004937d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:14.558872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969843c7-a5b6-459e-bcfb-fe39004937d6 None admin] PATH_INFO: `/v3/projects/6963a1147c6c484f865b71173e5c2b67` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:14.562288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969843c7-a5b6-459e-bcfb-fe39004937d6 None admin] RBAC: Authorizing `identity:get_project(project_id=6963a1147c6c484f865b71173e5c2b67)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:14.568068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969843c7-a5b6-459e-bcfb-fe39004937d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:14.569681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 571/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:20:14 2022] GET /identity/v3/projects/6963a1147c6c484f865b71173e5c2b67 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:14.576212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:14.673157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bee8-820c-4ad8-80ef-cf709da5f247 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:14.705956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:14.706538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:14.706815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:14.707083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:14.707788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=6963a1147c6c484f865b71173e5c2b67, user.id=b88d4d58d887479b9e85599eedba92f5) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:14.708087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:14.709482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d5b94-c50e-48c3-a37d-33dba5ee6e67 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:14.714651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 614/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:20:14 2022] GET /identity/v3/role_assignments?user.id=b88d4d58d887479b9e85599eedba92f5&scope.project.id=6963a1147c6c484f865b71173e5c2b67&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:16.574372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb27a9b-cc7d-4180-87ce-11e7d2fa63ab None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:16.574909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb27a9b-cc7d-4180-87ce-11e7d2fa63ab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:16.574909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb27a9b-cc7d-4180-87ce-11e7d2fa63ab None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:16.576249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 572/1186] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:16.581396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:16.581827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:16.581957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:16.600432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:16.601617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:16.642496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:16.667007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 615/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:20:16.933583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb27a9b-cc7d-4180-87ce-11e7d2fa63ab None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:17.032936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb27a9b-cc7d-4180-87ce-11e7d2fa63ab None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:17.057186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.065293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:17.065927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:17.066210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:17.066485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:17.076964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:20:17.081544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:20:17.082576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:20:17.083640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 573/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:20:17.089594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:17.184563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd460e6-fcd1-4fab-b180-4616b731e8ea None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:17.218805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:17.219397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:17.219673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:17.219946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:17.220607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:17.220908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:17.222289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:17.230391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 616/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:17.236147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:17.333279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d75cc9-834e-42c9-b6f8-57f0d6b3182c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:17.365461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:17.366090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:17.366376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:17.366650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] PATH_INFO: `/v3/users/b88d4d58d887479b9e85599eedba92f5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:17.367760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] RBAC: Authorizing `identity:get_user(user_id=b88d4d58d887479b9e85599eedba92f5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:17.369174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:17.371289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 574/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:20:17 2022] GET /identity/v3/users/b88d4d58d887479b9e85599eedba92f5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:17.376977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:17.415906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.473816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecdfb1-3b71-430d-8ad7-2a131b661d89 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:17.506271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6ba9f-15d1-4082-bb99-e77ac9095255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:17.506885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6ba9f-15d1-4082-bb99-e77ac9095255 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:17.507165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6ba9f-15d1-4082-bb99-e77ac9095255 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:17.507440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6ba9f-15d1-4082-bb99-e77ac9095255 None admin] PATH_INFO: `/v3/projects/6963a1147c6c484f865b71173e5c2b67` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:17.508529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6ba9f-15d1-4082-bb99-e77ac9095255 None admin] RBAC: Authorizing `identity:get_project(project_id=6963a1147c6c484f865b71173e5c2b67)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:17.509991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6ba9f-15d1-4082-bb99-e77ac9095255 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:17.512205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 617/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:20:17 2022] GET /identity/v3/projects/6963a1147c6c484f865b71173e5c2b67 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:17.518142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:17.573130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.616361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f370e-900d-4a2a-a518-4e879bb7d985 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:17.649405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005ab1-2751-4f6d-9654-191f20095fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:17.650080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ab1-2751-4f6d-9654-191f20095fd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:17.650358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ab1-2751-4f6d-9654-191f20095fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:17.650662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005ab1-2751-4f6d-9654-191f20095fd4 None admin] PATH_INFO: `/v3/projects/6963a1147c6c484f865b71173e5c2b67/users/b88d4d58d887479b9e85599eedba92f5/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:17.652820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ab1-2751-4f6d-9654-191f20095fd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6963a1147c6c484f865b71173e5c2b67, user_id=b88d4d58d887479b9e85599eedba92f5, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:17.654258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005ab1-2751-4f6d-9654-191f20095fd4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:17.758306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 575/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:20:17 2022] PUT /identity/v3/projects/6963a1147c6c484f865b71173e5c2b67/users/b88d4d58d887479b9e85599eedba92f5/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:20:19.676136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576472e-f838-49f0-92af-add59ecf0871 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:19.676670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576472e-f838-49f0-92af-add59ecf0871 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:19.676670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576472e-f838-49f0-92af-add59ecf0871 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:19.678027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 618/1193] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:20:19.683496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:19.683938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:19.684042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:19.703351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:20:19.704545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:20:19.775330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 576/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:20:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:20:20.079118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576472e-f838-49f0-92af-add59ecf0871 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:20.180705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576472e-f838-49f0-92af-add59ecf0871 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:20.188475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:20.215958 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:20.216576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:20.216848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:20.217115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:20.226695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:20:20.231847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:20:20.232943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:20:20.234245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 619/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:20:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:20:20.239059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:20.283563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:20.336547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652326-c80b-4401-b726-ef782ab89af6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:20.368183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:20.368782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:20.369062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:20.369977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:20.370644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:20.370951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:20.372611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:20.380936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 577/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:20:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:20.387576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:20.483251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddac147-f1f9-4b38-bad6-ec96c6142413 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:20.516468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:20.517074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:20.517352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:20.517621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] PATH_INFO: `/v3/users/b88d4d58d887479b9e85599eedba92f5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:20.518748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] RBAC: Authorizing `identity:get_user(user_id=b88d4d58d887479b9e85599eedba92f5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:20.520139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:20.521663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 620/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 24 09:20:20 2022] GET /identity/v3/users/b88d4d58d887479b9e85599eedba92f5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:20.527562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:20.625439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e5bfb-6183-46b9-a460-02fdf14c7a7d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:20.632147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:20.658208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:20.658797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:20.659079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:20.659353 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:20.724654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:20.726112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:20.821489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 578/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:20:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:20.827407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:20.861205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:20.925482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420935ec-8d6b-4976-9fa3-b70a099a3d74 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:20.957992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6c392-58c0-45b0-b05d-d93616918a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:20.958601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6c392-58c0-45b0-b05d-d93616918a73 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:20.958878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6c392-58c0-45b0-b05d-d93616918a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:20.959149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6c392-58c0-45b0-b05d-d93616918a73 None admin] PATH_INFO: `/v3/projects/6963a1147c6c484f865b71173e5c2b67` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:20.960230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6c392-58c0-45b0-b05d-d93616918a73 None admin] RBAC: Authorizing `identity:get_project(project_id=6963a1147c6c484f865b71173e5c2b67)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:20.961664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6c392-58c0-45b0-b05d-d93616918a73 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:20.964213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 621/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 24 09:20:20 2022] GET /identity/v3/projects/6963a1147c6c484f865b71173e5c2b67 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:20.970913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:20:20.979576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:21.068889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51b30f-04d4-412b-a42f-62a600fff954 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:20:21.102962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:20:21.104425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:20:21.104716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:20:21.104990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:20:21.105708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=6963a1147c6c484f865b71173e5c2b67, user.id=b88d4d58d887479b9e85599eedba92f5) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:20:21.106043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:20:21.107497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643be142-2cff-4e5b-b178-c28c1556df1d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:20:21.113190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 579/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:20:20 2022] GET /identity/v3/role_assignments?user.id=b88d4d58d887479b9e85599eedba92f5&scope.project.id=6963a1147c6c484f865b71173e5c2b67&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:20:30.953963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=49 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:31.110728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=65 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:37.680863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60196c-56ba-49ad-b0bd-a022cc7e21f9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:37.681447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60196c-56ba-49ad-b0bd-a022cc7e21f9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:37.681447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60196c-56ba-49ad-b0bd-a022cc7e21f9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:37.682794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 622/1201] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:21:37.688000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:37.688423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:37.688552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:37.707025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:21:37.708231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:21:37.773595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 580/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:21:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:21:38.048146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60196c-56ba-49ad-b0bd-a022cc7e21f9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:38.148792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60196c-56ba-49ad-b0bd-a022cc7e21f9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:38.182242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:38.182865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:38.183182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:38.183453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:38.193283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:38.194803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:38.210055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:38.211373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:38.212824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:38.212824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:38.212824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:38.212824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 623/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:38.217416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:38.315699 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3fab-ce26-461b-b784-e1e4d322b50a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:38.344460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:38.350127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:38.350721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:38.351000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:38.351272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:38.351902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:38.352201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:38.353974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eabfb-d78a-4cc8-a8bd-e1d24024c08e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:38.364807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 581/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:38.371527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:38.423120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:38.470115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4d3e8-7259-40e2-bf7a-62ed2094d508 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:38.503184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50114-cd86-4274-8ff8-558bce0899fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:38.503778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50114-cd86-4274-8ff8-558bce0899fb None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:38.504054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50114-cd86-4274-8ff8-558bce0899fb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:38.504324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50114-cd86-4274-8ff8-558bce0899fb None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:38.504961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50114-cd86-4274-8ff8-558bce0899fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:38.506462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50114-cd86-4274-8ff8-558bce0899fb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:38.607995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 624/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 24 09:21:38 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:21:40.574512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71585c2b-afcb-45a4-8276-ba9101308d88 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:40.575073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71585c2b-afcb-45a4-8276-ba9101308d88 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:40.575178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71585c2b-afcb-45a4-8276-ba9101308d88 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:40.576486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 582/1206] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:21:40.581562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:40.582022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:40.582258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:40.600701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:21:40.602083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:21:40.668243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 625/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:21:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:21:40.939782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71585c2b-afcb-45a4-8276-ba9101308d88 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.043064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71585c2b-afcb-45a4-8276-ba9101308d88 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:41.076497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:41.077130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:41.077413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:41.077693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:41.088299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:21:41.092944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:41.094134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:41.095155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 583/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:41.100041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.139373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:41.196564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b758fde-d3d2-4ef3-b9de-116c603c632e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:41.231569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:41.232175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:41.232452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:41.232719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:41.233380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:41.233678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:41.235094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:41.242885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 626/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:41.248623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.298932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:41.347625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc669c-0ea2-413c-9425-15be00379449 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:41.379779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:41.380393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:41.380672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:41.380943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:41.391255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:41.394804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:41.406977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:41.408086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:41.409184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:41.409184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:41.409184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:41.409184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 584/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:41.414064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.511407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:41.514224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad534a91-8e25-42c2-8d4d-2c48104fc458 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:41.547188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:41.547787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:41.548064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:41.548333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:41.548965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:41.549266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:41.550630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:41.561218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 627/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:41.567252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.672435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8394a-3349-4b7b-a610-d3666327d1de None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:41.674014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:41.706788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:41.707411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:41.707692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:41.707966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:41.715878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:41.717305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:21:41.728688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:41.729925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:41.731203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 585/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:41.735767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.835393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570d23-c410-404f-b640-1ac6ea0d6791 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:41.871260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:41.871866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:41.872149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:41.872426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:41.873148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:41.873462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:41.874947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:41.893316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 628/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 24 09:21:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:41.899372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:41.997816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70adf-139f-45a0-ab4f-7d00d0e26d4b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:42.030967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:42.056223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:42.056223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:42.056223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:42.061269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:42.098477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:42.099823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:42.194441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 586/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:21:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:21:42.200628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:42.219937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:42.298855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c90f3-b94c-4262-a4f3-e4c1ad89cfca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:42.333181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:42.333801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:42.334107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:42.334378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:42.344080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:42.345504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:42.359776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:42.361007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:42.362240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:42.362240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:42.362240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:42.362240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 629/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:42.366664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:42.426368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:42.466502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7950db-fa18-43d9-a6e5-7db18538790e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:42.499707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:42.500301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:42.500580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:42.500849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:42.501495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:42.501777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:42.503176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:42.515669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 587/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:42.521312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:42.591262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:42.620844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de74c53-e800-4d6e-9883-4292eaba868c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:42.653203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:42.653827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:42.654140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:42.654411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:42.661480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:42.665773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:21:42.674415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:42.675523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:42.676431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 630/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:42.681904 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:42.781864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96606cbc-4ea6-4dea-8650-cc84b6eaf02c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:42.804123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:42.815489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:42.816096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:42.816380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:42.816645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:42.817589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:42.817927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:42.819357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499212-c1b0-4599-b180-a199fdb98da5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:42.831228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 588/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:42.838204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:42.937308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334038cf-98e2-4b12-b1b9-c1d618f23eb2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:42.967041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:42.972862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:42.973460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:42.973741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:42.974044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:42.974998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=1ae3f2f0b014430e8fb19ad7316b75c8) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:42.975308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:42.976732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c250-235a-4ef3-bf99-397185b38a42 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:42.982709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 631/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:21:42 2022] GET /identity/v3/role_assignments?user.id=1ae3f2f0b014430e8fb19ad7316b75c8&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:44.855497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90316413-a51c-418d-bc31-a2dd6f817d89 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:44.856016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90316413-a51c-418d-bc31-a2dd6f817d89 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:44.856116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90316413-a51c-418d-bc31-a2dd6f817d89 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:44.857538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 589/1220] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:21:44.862537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:44.863028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:44.863172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:44.880823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:21:44.882032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:21:44.948363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 632/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:21:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:21:45.222205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90316413-a51c-418d-bc31-a2dd6f817d89 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:45.323878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90316413-a51c-418d-bc31-a2dd6f817d89 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:45.358501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:45.359122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:45.359397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:45.359664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:45.369719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:21:45.374310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:45.375440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:45.376454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 590/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:21:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:45.381478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:45.480814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb1fd-f31e-4f60-9d49-46cbfb625d09 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:45.503637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:45.514621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:45.515224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:45.515504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:45.515778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:45.516435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:45.516737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:45.518117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:45.526775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 633/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:21:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:45.532646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:45.577222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:45.631121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53803d-38d4-44bc-8ef4-ea436bcd5dec None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:45.664904 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:45.665569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:45.665850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:45.666156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:45.675932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:45.677442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:45.692112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:45.694951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:45.696983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:45.696983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:45.696983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:45.696983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 591/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:45.699846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:45.797812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b748e-f006-43ad-b982-7bfb5239cae6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:45.832007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:45.832817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:45.833242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:45.833705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:45.834512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:45.834930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:45.836549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:45.849540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 634/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:45.855460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:45.950548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:45.957279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc850c34-fd37-466d-a5fb-0a4343cbffd3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:45.991215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:45.991839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:45.992118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:45.992395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:45.999267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.000704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:21:46.012158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:46.013269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:46.014461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 592/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:46.019098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:46.064886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:46.115544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa4cd6-3f78-49cc-a501-81c890f863c3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:46.147647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:46.148243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:46.148519 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:46.149352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:46.150082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:46.150380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.151779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:46.168736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 635/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 24 09:21:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:46.174414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:46.275024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c07e2-ba4f-428e-a48d-cf89981fae19 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:46.307605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:46.308250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:46.308529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:46.308798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:46.319558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.321555 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:46.335462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:46.336566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:46.337599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:46.337599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:46.337599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:46.337599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 593/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:46.342430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:46.438885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274718fa-d5e7-4a26-b2f6-1456c8ef8254 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:46.441137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:46.472630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:46.473229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:46.473508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:46.473846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:46.474514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:46.474815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.480288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:46.486889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 636/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:46.493247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:46.502704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:46.592398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b39ebd-7109-408c-aa1d-6ddf1761f571 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:46.624298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:46.624917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:46.625197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:46.625471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:46.631814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.633338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:21:46.644478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:46.646185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:46.647181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 594/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:46.652899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:46.754645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d006ee-06df-4bc4-9e00-8164a19e5d21 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:46.791930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:46.792543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:46.792826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:46.793102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:46.793792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:46.794131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.795757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab888-1c80-4c14-ae3e-002fcfec4023 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:46.808442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 637/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:21:46.814579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:46.881229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:46.916125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18429271-f643-4dea-b61b-3620efcb8daf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:46.949934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba9708-180b-479f-bc65-c324cc3ca15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:46.950586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9708-180b-479f-bc65-c324cc3ca15d None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:46.951139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9708-180b-479f-bc65-c324cc3ca15d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:46.951139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba9708-180b-479f-bc65-c324cc3ca15d None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/1ae3f2f0b014430e8fb19ad7316b75c8/roles/379b0ab615414156b0c0312da145aff1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:46.965016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9708-180b-479f-bc65-c324cc3ca15d None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=1ae3f2f0b014430e8fb19ad7316b75c8, role_id=379b0ab615414156b0c0312da145aff1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:46.966604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba9708-180b-479f-bc65-c324cc3ca15d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:47.030433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 595/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:21:46 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/1ae3f2f0b014430e8fb19ad7316b75c8/roles/379b0ab615414156b0c0312da145aff1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:21:48.915074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74e86-6e8b-4eee-aded-48618da04205 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:48.915653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74e86-6e8b-4eee-aded-48618da04205 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:48.915653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74e86-6e8b-4eee-aded-48618da04205 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:48.916928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 638/1233] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:21:48.922336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:48.922776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:48.922884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:48.941117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:21:48.942616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:21:49.006929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 596/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:21:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:21:49.279304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74e86-6e8b-4eee-aded-48618da04205 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:49.304147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:49.380593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74e86-6e8b-4eee-aded-48618da04205 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:49.414380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:49.415027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:49.415325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:49.415602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:49.425544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:21:49.430955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:49.432037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:49.433315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 639/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 24 09:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:49.438075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:49.483496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:49.536431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4578f-a4d3-41d5-8e19-944a6f6a9fdb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:49.569671 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:49.570328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:49.570609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:49.570971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:49.571631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:49.571933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:49.573282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:49.581545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 597/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 24 09:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:49.588163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:49.673017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:49.687722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f29e2-fe6a-4f88-a22f-aa63d5328e34 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:49.721006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:49.721623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:49.721924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:49.722198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:49.732072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:49.733485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:49.748022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:49.749175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:49.750327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:49.750327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:49.750327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:49.750327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 640/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:49.755466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:49.856302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86660-98bc-4f0a-8418-64c832025c2f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:49.865012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:49.890160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:49.890762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:49.891048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:49.891348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:49.891988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:49.892298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:49.893655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:49.905731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 598/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:49.911718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:50.009867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0cfc4-140b-4d17-931a-2073dbd9ec2c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:50.042442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:50.043076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:50.043356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:50.043625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:50.046377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:50.051215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:50.052646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:21:50.064208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:50.065301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:50.066714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 641/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:50.072175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:50.171918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab0a7-b954-43d4-81fd-682aff419587 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:50.206233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:50.206834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:50.207116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:50.207389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:50.208107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:50.208412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:50.209846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:50.226787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 599/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 24 09:21:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:50.232785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:50.332031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203556-837b-48a6-a6ef-61d3b6053386 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:50.365803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:50.366453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:50.366716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:50.366995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:50.426606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:50.432867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:50.434400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:50.530182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 642/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:21:50.536046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:50.564821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:50.636209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f88f9-92ed-4711-bc56-949c34713afd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:50.670983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:50.671602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:50.671875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:50.672180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:50.681935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:50.683388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:50.698190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:50.699330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:50.700430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:50.700430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:50.700430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:50.700430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 600/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:50.706757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:50.800061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:50.806424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393804e-59ce-40cd-b3e6-010aef22943e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:50.840257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:50.841133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:50.841432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:50.841992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:50.843015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:50.843339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:50.844711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:50.855848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 643/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:50.861463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:50.942689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:50.968789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f177935-560b-4bd1-b2c1-25b1dab9486c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:51.001335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:51.009705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:51.009705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:51.009705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:51.009705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:51.011045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:21:51.022031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:51.023964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:51.025361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 601/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:51.029151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:51.128173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f6fbf-ac2f-49d7-9bf9-53f0d45f53cc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:51.162670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:51.163378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:51.163660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:51.164447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:51.165330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:51.165634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:51.167065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4c06c-3754-4b93-9f27-de9949495e49 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:51.178512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 644/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:51.185554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:51.283970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42e99e-d120-44f4-b180-8abdadc2339d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:51.316679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:51.317267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:51.317546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:51.317817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:51.318564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] RBAC: Adding query filter params (role.id=379b0ab615414156b0c0312da145aff1, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=1ae3f2f0b014430e8fb19ad7316b75c8) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:51.318906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:51.321183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49d263-bfe6-41e7-9504-679f50fe5c03 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:51.330533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 602/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:21:51 2022] GET /identity/v3/role_assignments?user.id=1ae3f2f0b014430e8fb19ad7316b75c8&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=379b0ab615414156b0c0312da145aff1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:53.279912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79061c60-e53f-4060-aa1a-9dcde744647a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:53.280476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79061c60-e53f-4060-aa1a-9dcde744647a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:53.280476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79061c60-e53f-4060-aa1a-9dcde744647a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:53.281792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 645/1247] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:21:53.287164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:53.287586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:53.287727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:53.294187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:53.306607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:21:53.307798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:21:53.373293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 603/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:21:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:21:53.643409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79061c60-e53f-4060-aa1a-9dcde744647a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:53.661072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:53.743490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79061c60-e53f-4060-aa1a-9dcde744647a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:53.776838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:53.777462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:53.777739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:53.778038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:53.787865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:21:53.793732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:53.794909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:53.795899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 646/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:53.800757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:53.899053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f563-1227-45dd-870e-10db04fe3ee1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:53.927750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:53.932658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:53.933262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:53.933548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:53.933832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:53.934518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:53.934822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:53.936174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:53.944234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 604/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:53.950423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:54.026371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:54.048616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a18bd-f12a-43f5-ac69-7021d60b22a5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:54.081008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:54.081620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:54.081928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:54.082201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:54.093702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:54.095206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:54.112738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:54.113882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:54.115011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:54.115011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:54.115011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:54.115011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 647/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:54.119784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:54.220448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520edb2b-c786-4669-9156-3cc94d4db72d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:54.253954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:54.254546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:54.254824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:54.255095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:54.255724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:54.256023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:54.257933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:54.269401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 605/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:54.275745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:54.374259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42648931-5aa0-409d-85ea-adcc8f899c62 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:54.400981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:54.408575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:54.409192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:54.409470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:54.409743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:54.423167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:54.424590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:21:54.435709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:54.436816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:54.438095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 648/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:54.442967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:54.497775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:54.541933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2b852-cf1b-4590-9b61-932ce8158d56 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:54.576398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:54.576987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:54.577263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:54.577529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:54.578271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:54.578577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:54.579968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:54.596436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 606/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 24 09:21:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:54.602511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:54.702182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8ee5-15fd-4da9-b84b-4c4dc3d1a727 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:54.736533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:54.737169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:54.737453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:54.737726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:54.794602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:54.806999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:54.808418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:54.903605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 649/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:21:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:21:54.909499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:55.010448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05daaade-abdb-43b2-bdef-3627dd521048 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:55.024046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:55.044448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:55.050014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:55.050014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:55.050014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:55.055467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:55.056881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:55.071669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:55.072831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:55.074373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:55.074373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:55.074373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:55.074373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 607/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:55.078734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:55.164871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:55.176424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c43be-e14d-4b17-b163-4da413ac8120 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:55.209764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:55.211659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:55.211659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:55.211865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:55.212467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:55.212771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:55.214148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:55.224900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 650/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:55.230782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:55.329989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c36dc-dcaf-49b8-afd5-e30559432bc8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:55.362995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:55.363614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:55.363920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:55.364222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:55.371559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:55.373007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:21:55.384788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:55.385905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:21:55.386982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 608/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:55.391868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:55.493124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99835ca4-7dbb-4116-9c14-b637414f471c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:55.525801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:55.526429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:55.526711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:55.526985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:55.527665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:55.527969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:55.529376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268adb3f-eddb-4f92-818f-0b0d783a6f76 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:55.541840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 651/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:55.547966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:55.575269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:55.646193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0df78-d14a-4b95-95bd-6974b79e9a08 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:55.680775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:55.681632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:55.682042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:55.682410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:55.683235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=1ae3f2f0b014430e8fb19ad7316b75c8) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:55.683656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:55.685072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f0d8a-347f-429f-b5ff-9aa3b40d292a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:55.690518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 609/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:21:55 2022] GET /identity/v3/role_assignments?user.id=1ae3f2f0b014430e8fb19ad7316b75c8&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:57.626373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339a66-b716-4b50-8e27-57e5e333cf12 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:57.626902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339a66-b716-4b50-8e27-57e5e333cf12 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:57.626992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339a66-b716-4b50-8e27-57e5e333cf12 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:57.628325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 652/1261] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:21:57.634328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:57.634701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:57.634866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:57.652654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:21:57.653825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:21:57.719293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 610/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:21:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:21:57.996679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339a66-b716-4b50-8e27-57e5e333cf12 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:58.008236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:58.097977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339a66-b716-4b50-8e27-57e5e333cf12 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:58.130829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:58.131444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:58.131713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:58.132496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:58.142526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:21:58.147147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:58.149039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:58.150281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 653/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:21:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:58.155281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:58.173736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:58.251663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec51a6-5ef9-46d9-8df2-fc81e348da2e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:58.284398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:58.285036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:58.285313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:58.285582 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:58.286268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:58.286569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:58.287916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:58.296641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 611/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:58.302394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:58.369725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:58.402196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c33bc-f004-4284-a253-3ae6b67eb9a7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:58.434978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:58.435693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:58.435973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:58.436245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:58.446561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:58.447984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:58.461686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:58.462749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:58.464021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:58.464021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:58.464021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:58.464021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 654/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:58.468912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:58.549628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:58.568373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ee51b-2de0-4d8f-9ada-da9a2499289f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:58.601795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:58.602418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:58.602701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:58.602975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:58.603608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:58.603910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:58.605334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:58.616058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 612/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:58.621896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:58.720452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a62725-2245-47b8-97c3-8a4384843c77 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:58.739108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:58.752867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:58.753523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:58.753801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:58.754099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:58.761729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:58.763178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:21:58.774364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:58.781593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:58.782789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 655/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:58.783509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:58.883011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e078122-1395-46d9-a63c-916e4942a416 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:58.918679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:58.919270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:58.919589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:58.919978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:58.920694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:58.920997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:58.922449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:58.932063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:58.939865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 613/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 24 09:21:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:21:58.946195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:59.050410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8234d4-d811-4a97-b91c-b364351b267c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:59.094383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:59.094934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:59.095223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:59.095494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:59.106981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:59.108425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:21:59.122159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:59.123250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:21:59.124343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:21:59.124343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:21:59.124343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:59.124343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 656/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:59.129205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:59.228776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c469b2-ab05-43ae-9e72-b66a317fdb24 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:59.263912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:59.264499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:59.264784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:59.265061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:59.265703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:59.266041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:59.267539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:59.279600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 614/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:59.285656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:59.317376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:59.384099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22a238-440e-4c81-99a6-a0789058b848 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:59.417702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:59.418426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:59.418705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:59.418979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:59.425412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:59.426883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:21:59.439053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:21:59.439967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:21:59.441168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 657/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:21:59.447098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:59.511339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:59.551030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c5d4c-565a-4e19-94c7-1cad64cd89dc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:59.583745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:59.584372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:59.584660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:59.585095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:59.586345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:21:59.586653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:59.588127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae88b-c307-4518-96fd-97d218b4136a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:59.599718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 615/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:21:59.606020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:21:59.697293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:59.705875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02811367-cdfb-49db-affe-5b93e9786eea None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:21:59.738928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933e95c-0b8b-486a-8732-c5ca27ed3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:21:59.739616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933e95c-0b8b-486a-8732-c5ca27ed3154 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:21:59.739837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933e95c-0b8b-486a-8732-c5ca27ed3154 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:21:59.740107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933e95c-0b8b-486a-8732-c5ca27ed3154 None admin] PATH_INFO: `/v3/projects/b444e8775cb144ad8413d4571770f098/users/1ae3f2f0b014430e8fb19ad7316b75c8/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:21:59.742265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933e95c-0b8b-486a-8732-c5ca27ed3154 None admin] RBAC: Authorizing `identity:create_grant(project_id=b444e8775cb144ad8413d4571770f098, user_id=1ae3f2f0b014430e8fb19ad7316b75c8, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:21:59.743671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933e95c-0b8b-486a-8732-c5ca27ed3154 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:21:59.810834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 658/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 24 09:21:59 2022] PUT /identity/v3/projects/b444e8775cb144ad8413d4571770f098/users/1ae3f2f0b014430e8fb19ad7316b75c8/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:22:01.743066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5ac5-238a-4bff-998d-a4b8ea43fc4f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:01.743627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5ac5-238a-4bff-998d-a4b8ea43fc4f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:01.743627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5ac5-238a-4bff-998d-a4b8ea43fc4f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:01.744985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 616/1274] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:22:01.750315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:01.750717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:01.750874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:01.769403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:22:01.770626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:22:01.839618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 659/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:22:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:22:02.121191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5ac5-238a-4bff-998d-a4b8ea43fc4f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:02.220438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5ac5-238a-4bff-998d-a4b8ea43fc4f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:02.237463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:02.254407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:02.255029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:02.255312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:02.255585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:02.266158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:22:02.270767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:02.271865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:02.273563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 617/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 24 09:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:02.281750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:02.356643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:02.374355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121868a-a683-4637-a9d1-069baa5a3d90 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:02.406947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:02.407545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:02.407824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:02.408094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:02.408750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:02.409044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:02.410421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:02.419035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 660/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 24 09:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:02.424980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:02.527151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ecd4-ec42-4e0d-866d-12b979458d90 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:02.560217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:02.560835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:02.561120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:02.561385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:02.572159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:02.573588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:22:02.588249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:02.592130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:22:02.593269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:22:02.593269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:22:02.593269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:02.593269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 618/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:02.595390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:02.693820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1386f-b116-4e4b-a90c-3f501f1cbf61 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:02.726979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:02.727571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:02.727850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:02.728122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:02.728755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:02.729055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:02.730456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:02.743647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 661/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:02.747709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:02.780569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:02.847788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafe215-5397-4ae1-8e71-f0d1a5dce763 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:02.880052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:02.880659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:02.880935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:02.881201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:02.889420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:02.891035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:22:02.902210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:02.903369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:02.904701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 619/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:22:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:02.909171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:02.913104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:03.009675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccbbb6-43d6-4d9d-a744-70714176d1fe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:03.042819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:03.043408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:03.043713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:03.044034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:03.044753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:03.045053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:03.046478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:03.062845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 662/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 24 09:22:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:03.068920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:03.159419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:03.169107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914c90-4f63-4988-bc29-d3f213db2b57 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:03.202099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:03.202696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:03.202978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:03.203252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:03.267189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:03.268529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:03.363715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 620/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 24 09:22:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:22:03.370406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:03.431494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:03.468375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df8d10-470d-4b83-a5e6-aa7029d6cbb3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:03.481255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:03.501758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:03.502404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:03.502685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:03.502960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:03.513126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:03.514593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:22:03.529960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:03.531173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:22:03.532171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:22:03.532171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:22:03.532171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:22:03.532171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 663/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:03.536988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:03.633247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b24ef-a57d-40ee-a54d-76ccbcd25898 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:03.666673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:03.667269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:03.667551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:03.667824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:03.668462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:03.668765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:03.670193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:03.681632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 621/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 24 09:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:03.687399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:03.785727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bffb9-df3f-4399-8977-d5a094480165 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:03.799595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:03.819203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:03.820011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:03.820291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:03.820560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:03.827916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:03.831775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:22:03.841620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:03.845951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 24 09:22:03.847119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 664/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 24 09:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:03.848858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:03.900918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:03.949162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2168bd-bd08-4899-838e-a4af26588938 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:03.983438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:03.984045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:03.984332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:03.984609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:03.985341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:03.985675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:03.987194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1475200-2f0d-4de4-ab0b-95db8f191686 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:03.999352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 622/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 24 09:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:04.005571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:04.106274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e81a6-dd5f-4933-91bf-d038bb27b3c8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:04.138999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:04.139594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:04.139874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:04.140144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:04.143212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] RBAC: Adding query filter params (role.id=a869e27f1a774ce0988b7fb510c999a0, scope.project.id=b444e8775cb144ad8413d4571770f098, user.id=1ae3f2f0b014430e8fb19ad7316b75c8) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:04.143212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:04.143212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74d69e-63c1-4e40-abe8-dc5640775d7b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:04.148901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 665/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 24 09:22:04 2022] GET /identity/v3/role_assignments?user.id=1ae3f2f0b014430e8fb19ad7316b75c8&scope.project.id=b444e8775cb144ad8413d4571770f098&role.id=a869e27f1a774ce0988b7fb510c999a0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:06.060883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503621-ddea-4112-985e-c530a0b2a59c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:06.061414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503621-ddea-4112-985e-c530a0b2a59c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:06.061527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503621-ddea-4112-985e-c530a0b2a59c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:06.062797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 623/1288] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:22:06.068230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:06.068621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:06.068783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:06.089562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:22:06.089562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:22:06.117321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:06.153925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 666/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:22:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:22:06.435094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17503621-ddea-4112-985e-c530a0b2a59c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:06.539495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17503621-ddea-4112-985e-c530a0b2a59c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:06.550170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:06.574220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:06.574835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:06.575220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:06.575491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:06.576119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:06.577418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:06.586209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:06.587409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:06.588331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 624/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:22:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:06.593443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:06.691093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f650a3-7d72-45ee-a840-89adcbdd8b27 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:06.725798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:06.726486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:06.726798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:06.727092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:06.727758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:06.728097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:06.729646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9e228-53df-49ab-bc77-d1e72b3aab1f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:06.734557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 667/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 24 09:22:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:22:06.740415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:06.844130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c334b-3b94-4339-b119-1d4b7ee16999 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:06.879922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:06.880627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:06.880909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:06.881207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:06.882168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:06.882487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:06.883919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241f450-229a-48b3-8aaf-52506eafa3d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:06.888678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 625/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 24 09:22:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:08.800409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8d68e-2818-49d1-977a-3a4544ded310 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:08.800940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8d68e-2818-49d1-977a-3a4544ded310 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:08.800940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8d68e-2818-49d1-977a-3a4544ded310 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:08.802300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 668/1293] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:22:08.808125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24af4-7ec4-4017-bcfd-71ffabe46e46 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:08.808579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24af4-7ec4-4017-bcfd-71ffabe46e46 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:08.808689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24af4-7ec4-4017-bcfd-71ffabe46e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:08.827611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c6d24af4-7ec4-4017-bcfd-71ffabe46e46 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:22:08.828808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c6d24af4-7ec4-4017-bcfd-71ffabe46e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:22:08.857840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:08.894407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 626/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:22:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:22:09.160359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8d68e-2818-49d1-977a-3a4544ded310 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:09.192581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:09.259371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8d68e-2818-49d1-977a-3a4544ded310 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:09.291640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a5f69-668a-4ba8-ab83-3273c8602c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:09.292238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5f69-668a-4ba8-ab83-3273c8602c02 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:09.292519 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5f69-668a-4ba8-ab83-3273c8602c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:09.292790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5f69-668a-4ba8-ab83-3273c8602c02 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:09.293431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a5f69-668a-4ba8-ab83-3273c8602c02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:09.294816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a5f69-668a-4ba8-ab83-3273c8602c02 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:09.416548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 669/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 24 09:22:09 2022] POST /identity/v3/services => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:22:11.321272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6bc8-7132-4de8-b104-f73d0b625489 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:11.321891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6bc8-7132-4de8-b104-f73d0b625489 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:11.321891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6bc8-7132-4de8-b104-f73d0b625489 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:11.323267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 627/1296] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:22:11.328525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:11.328943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:11.329087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:11.346792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:22:11.347982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:22:11.420053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 670/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:22:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:22:11.701727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6bc8-7132-4de8-b104-f73d0b625489 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:11.800599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6bc8-7132-4de8-b104-f73d0b625489 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:11.836006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:11.836630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:11.836911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:11.837190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:11.837769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:11.839155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:11.847711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:11.848889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:11.850039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 628/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:22:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:11.855583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:11.873987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:11.952582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154e925-9697-4ef2-93a1-7842eec736a1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:11.985268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:11.985888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:11.986166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:11.986437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:11.987059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:11.987358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:11.988700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:11.994143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 671/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 24 09:22:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:12.000333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:12.031859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:12.098740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e49c-c62d-48b3-a0ed-6f45306416fd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:12.134251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:12.134874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:12.135195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:12.135473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:12.136242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] RBAC: Adding query filter params (interface=public, service_id=057afe086bb2451faea4ad9482962c42, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:12.136571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:12.138150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b78f-3617-485b-b8e0-a46f4bb75c8a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:12.143464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 629/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 24 09:22:11 2022] GET /identity/v3/endpoints?service_id=057afe086bb2451faea4ad9482962c42&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:22:12.149375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:12.229215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:12.247017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b6a2a-1b79-4503-a35d-729ebc7fdb34 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:12.281410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154aafc-21cc-48cb-954b-5a302530d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:12.282031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154aafc-21cc-48cb-954b-5a302530d11e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:12.282311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154aafc-21cc-48cb-954b-5a302530d11e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:12.282578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154aafc-21cc-48cb-954b-5a302530d11e None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:12.283173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154aafc-21cc-48cb-954b-5a302530d11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:12.284514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154aafc-21cc-48cb-954b-5a302530d11e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:12.291653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 672/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 24 09:22:12 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:22:14.177021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20e7e-fa52-4469-8ca8-1bbcc12fdeee None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:14.178183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20e7e-fa52-4469-8ca8-1bbcc12fdeee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:14.178183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa20e7e-fa52-4469-8ca8-1bbcc12fdeee None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:14.179367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 630/1302] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:22:14.184811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:14.185228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:14.185403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:14.204261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:22:14.205427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:22:14.270464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 673/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:22:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:22:14.558465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20e7e-fa52-4469-8ca8-1bbcc12fdeee None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:14.653014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:14.659452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa20e7e-fa52-4469-8ca8-1bbcc12fdeee None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:14.692413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:14.693548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:14.693915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:14.694445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:14.695029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:14.696380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:22:14.704848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:22:14.706264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 24 09:22:14.707620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 631/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 24 09:22:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:22:14.713100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:14.786767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:14.810025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae27d2-c0e9-4ebf-af44-dc63ecc6c2b0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:14.843986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:14.844595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:14.844874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:14.845146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:14.845771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:22:14.846101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:14.847451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b82a73-fda4-4844-89af-589fea834adb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:14.852530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 674/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 24 09:22:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:22:14.858294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:22:14.957594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7bae8-0acf-46ed-97fa-928636c50511 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:22:14.991541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966a653-a9d2-4440-b46f-6ec9515c0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:22:14.992139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966a653-a9d2-4440-b46f-6ec9515c0808 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:22:14.992426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966a653-a9d2-4440-b46f-6ec9515c0808 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:22:14.992700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966a653-a9d2-4440-b46f-6ec9515c0808 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:22:14.993365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966a653-a9d2-4440-b46f-6ec9515c0808 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:22:14.995086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966a653-a9d2-4440-b46f-6ec9515c0808 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:22:15.079816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 632/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:22:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:22:24.862143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=30 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:25.075248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:59.429501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d4012-ac27-4a0c-a30d-213bf194ee56 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:28:59.430118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d4012-ac27-4a0c-a30d-213bf194ee56 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:28:59.430479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d4012-ac27-4a0c-a30d-213bf194ee56 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:28:59.433727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 675/1307] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:28:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:28:59.442502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240aaa-9ec9-4cf3-a329-425ff1792c66 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:28:59.443086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240aaa-9ec9-4cf3-a329-425ff1792c66 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:28:59.443416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51240aaa-9ec9-4cf3-a329-425ff1792c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:28:59.579339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-51240aaa-9ec9-4cf3-a329-425ff1792c66 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:28:59.581229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-51240aaa-9ec9-4cf3-a329-425ff1792c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:28:59.791068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 633/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:00.325569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48527495-368c-4edb-b698-eafec2e00412 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:00.332645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48527495-368c-4edb-b698-eafec2e00412 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:00.332645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48527495-368c-4edb-b698-eafec2e00412 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:00.332645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 676/1309] 10.222.0.60 () {54 vars in 965 bytes} [Wed Aug 24 09:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:00.337391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d12c2-2409-4995-affe-8e1ec3629168 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:00.337715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d12c2-2409-4995-affe-8e1ec3629168 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:00.337991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d12c2-2409-4995-affe-8e1ec3629168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:00.448158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d57d12c2-2409-4995-affe-8e1ec3629168 None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:00.449782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d57d12c2-2409-4995-affe-8e1ec3629168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:00.478299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:00.564516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48527495-368c-4edb-b698-eafec2e00412 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:00.566457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-48527495-368c-4edb-b698-eafec2e00412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:00.571501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 634/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Aug 24 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:00.737089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48527495-368c-4edb-b698-eafec2e00412 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:00.893302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:00.894695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:00.895468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:00.896287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:00.900832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:00.988155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:01.063174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:01.065250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fdcfa-d832-4c75-83ab-81274df63418 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:01.090545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 677/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:29:03.522002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ae64-896c-4636-bb77-d3d3e0980051 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:03.522733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ae64-896c-4636-bb77-d3d3e0980051 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:03.522733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0ae64-896c-4636-bb77-d3d3e0980051 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:03.524862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 635/1312] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:03.533496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e11db-2b79-4746-89b1-4933629cfca7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:03.534109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e11db-2b79-4746-89b1-4933629cfca7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:03.534400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e11db-2b79-4746-89b1-4933629cfca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:03.629294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-025e11db-2b79-4746-89b1-4933629cfca7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:03.630619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-025e11db-2b79-4746-89b1-4933629cfca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:03.749824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 678/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:04.038575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ae64-896c-4636-bb77-d3d3e0980051 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:04.040165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3cd0ae64-896c-4636-bb77-d3d3e0980051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:04.145072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0ae64-896c-4636-bb77-d3d3e0980051 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:04.219782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:04.222838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:04.223440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:04.223717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:04.224031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:04.225645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:04.345652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:04.347255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f5331-4d82-431f-8a74-c5a1d5405287 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:04.366013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 636/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:07.036126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26961cd-0be8-4919-b2af-c66eea53e1c3 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:07.036918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26961cd-0be8-4919-b2af-c66eea53e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:07.037041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26961cd-0be8-4919-b2af-c66eea53e1c3 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:07.038338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 679/1315] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:07.044050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1d24-df1d-4497-ab55-fed0ec04f046 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:07.044620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1d24-df1d-4497-ab55-fed0ec04f046 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:07.044620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1d24-df1d-4497-ab55-fed0ec04f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:07.138608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a52c1d24-df1d-4497-ab55-fed0ec04f046 None None] MFA Rules not processed for user `8f6560bddfbf45d5a00b083ee16509c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:07.138608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a52c1d24-df1d-4497-ab55-fed0ec04f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:07.183126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:07.229537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 637/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:07.529325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26961cd-0be8-4919-b2af-c66eea53e1c3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:07.531006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e26961cd-0be8-4919-b2af-c66eea53e1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:07.541947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:07.643847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26961cd-0be8-4919-b2af-c66eea53e1c3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:07.720953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:07.721570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:07.721870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:07.722157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:07.723786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:07.793312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:07.843615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:07.845098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674830d-641a-4a1c-807f-a55b190d293f service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:07.864191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 680/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:10.707983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480820-76a2-4f27-b794-d459f836f871 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:10.708545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480820-76a2-4f27-b794-d459f836f871 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:10.708545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480820-76a2-4f27-b794-d459f836f871 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:10.710029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 638/1318] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:10.716560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb303ac-347e-4010-9d15-d23de1e84106 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:10.717112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb303ac-347e-4010-9d15-d23de1e84106 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:10.717112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb303ac-347e-4010-9d15-d23de1e84106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:10.786086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1cb303ac-347e-4010-9d15-d23de1e84106 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:10.787616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1cb303ac-347e-4010-9d15-d23de1e84106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:10.907012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 681/1319] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:29:11.207148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480820-76a2-4f27-b794-d459f836f871 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:11.208716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-72480820-76a2-4f27-b794-d459f836f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:11.320071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480820-76a2-4f27-b794-d459f836f871 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:11.405202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:11.405817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:11.406133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:11.406407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:11.408080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:11.417342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:11.530444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:11.531947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b78dc-b019-4382-8105-4f2a5a7daf64 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:11.552011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 639/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:14.595264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3cba-0ff6-416b-9c03-173608850d14 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:14.595955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3cba-0ff6-416b-9c03-173608850d14 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:14.595955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3cba-0ff6-416b-9c03-173608850d14 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:14.597176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 682/1321] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:14.603610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3809fa-54c1-451a-9fa6-6153ffe0aede None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:14.604130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3809fa-54c1-451a-9fa6-6153ffe0aede None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:14.604226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3809fa-54c1-451a-9fa6-6153ffe0aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:14.672070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9d3809fa-54c1-451a-9fa6-6153ffe0aede None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:14.673301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d3809fa-54c1-451a-9fa6-6153ffe0aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:14.733906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:14.776058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 640/1322] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:15.083512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09da7-acb7-4465-b78b-c609270715d9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:15.083790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09da7-acb7-4465-b78b-c609270715d9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:15.084060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09da7-acb7-4465-b78b-c609270715d9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:15.085405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 683/1323] 10.222.0.60 () {54 vars in 965 bytes} [Wed Aug 24 09:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:15.092439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec24c-cd15-42a7-924c-9bec29018659 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:15.092730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec24c-cd15-42a7-924c-9bec29018659 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:15.093005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ec24c-cd15-42a7-924c-9bec29018659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:15.188618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ae2ec24c-cd15-42a7-924c-9bec29018659 None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:15.190520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ae2ec24c-cd15-42a7-924c-9bec29018659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:15.310474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 641/1324] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Aug 24 09:29:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:15.323005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09da7-acb7-4465-b78b-c609270715d9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:15.324736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dbe09da7-acb7-4465-b78b-c609270715d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:15.345316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:15.453146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09da7-acb7-4465-b78b-c609270715d9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:15.531997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:15.532607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:15.532882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:15.533152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:15.534787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:15.612325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:15.652404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:15.653846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1bb9-799d-4a3d-bb26-508d664dde99 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:15.673381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 684/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:17.925481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837be26-da14-4442-9d7c-2a14791a24bd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:17.926152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837be26-da14-4442-9d7c-2a14791a24bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:17.926152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837be26-da14-4442-9d7c-2a14791a24bd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:17.927462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 642/1326] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:17.933743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fcd7b-8e63-4d2a-9409-3dff800163b6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:17.934342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fcd7b-8e63-4d2a-9409-3dff800163b6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:17.934342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fcd7b-8e63-4d2a-9409-3dff800163b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:18.013571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-353fcd7b-8e63-4d2a-9409-3dff800163b6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:18.014886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-353fcd7b-8e63-4d2a-9409-3dff800163b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:18.127372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 685/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:18.414250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837be26-da14-4442-9d7c-2a14791a24bd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:18.416644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3837be26-da14-4442-9d7c-2a14791a24bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:18.487845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:18.543787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837be26-da14-4442-9d7c-2a14791a24bd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:18.639731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:18.640386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:18.640672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:18.640954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:18.642693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:18.791957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:18.794492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:18.796015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa678e8-a8a8-4553-973f-c1e5417c0c6f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:18.823891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 643/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:20.847568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea3c8-d17e-4f13-a71c-95e434b76272 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:20.848149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea3c8-d17e-4f13-a71c-95e434b76272 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:20.848149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea3c8-d17e-4f13-a71c-95e434b76272 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:20.849457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 686/1329] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:20.856338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4670-3546-41f7-9dfa-b58b60c54a17 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:20.856864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4670-3546-41f7-9dfa-b58b60c54a17 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:20.857126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4670-3546-41f7-9dfa-b58b60c54a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:20.931036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-34af4670-3546-41f7-9dfa-b58b60c54a17 None None] MFA Rules not processed for user `8f6560bddfbf45d5a00b083ee16509c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:20.932277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34af4670-3546-41f7-9dfa-b58b60c54a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:21.090478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 644/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:21.377354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ea3c8-d17e-4f13-a71c-95e434b76272 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:21.378983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-139ea3c8-d17e-4f13-a71c-95e434b76272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:21.412696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:21.487388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ea3c8-d17e-4f13-a71c-95e434b76272 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:21.566476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:21.568088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:21.568088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:21.568289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:21.571612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:21.670005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:21.716657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:21.718199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f30bb3-946c-40bf-8372-1cab79d33918 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:21.740615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 687/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:24.367771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeafd6-b874-4183-90f8-140f28d2fc07 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:24.368354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeafd6-b874-4183-90f8-140f28d2fc07 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:24.368354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeafd6-b874-4183-90f8-140f28d2fc07 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:24.369647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 645/1332] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:24.375663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021286-394e-4458-9c5f-84691871d3ab None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:24.376244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021286-394e-4458-9c5f-84691871d3ab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:24.376244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17021286-394e-4458-9c5f-84691871d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:24.453477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-17021286-394e-4458-9c5f-84691871d3ab None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:24.454787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-17021286-394e-4458-9c5f-84691871d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:24.563616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 688/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:24.861182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeafd6-b874-4183-90f8-140f28d2fc07 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:24.862791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bddeafd6-b874-4183-90f8-140f28d2fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:24.936293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:24.982174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeafd6-b874-4183-90f8-140f28d2fc07 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:25.071459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:25.072091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:25.072382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:25.072662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:25.074717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:25.202384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:25.203921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96479e60-89fc-48d1-8c3c-e9d634f3acfb service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:25.217266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:25.228760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 646/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:27.397445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a66242-3a16-4725-861d-25e902a4badb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:27.398378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a66242-3a16-4725-861d-25e902a4badb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:27.398669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a66242-3a16-4725-861d-25e902a4badb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:27.400137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 689/1335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:27.406210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74bbc2-a4bc-4aa3-b3a6-1a73950f71ca None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:27.406781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74bbc2-a4bc-4aa3-b3a6-1a73950f71ca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:27.406781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74bbc2-a4bc-4aa3-b3a6-1a73950f71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:27.485550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9a74bbc2-a4bc-4aa3-b3a6-1a73950f71ca None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:27.486863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9a74bbc2-a4bc-4aa3-b3a6-1a73950f71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:27.622626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 647/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:27.917636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a66242-3a16-4725-861d-25e902a4badb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:27.919213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c1a66242-3a16-4725-861d-25e902a4badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:27.973981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:28.056513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a66242-3a16-4725-861d-25e902a4badb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:28.145397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:28.146398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:28.146849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:28.148059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:28.149824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:28.233542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:28.264778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:28.266286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb062ef-e1dc-4cb0-b5e1-e3420cc8429a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:28.285930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 690/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:31.136053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76645a6b-fa56-44b0-be40-14429a67a2de None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:31.136740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76645a6b-fa56-44b0-be40-14429a67a2de None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:31.136957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76645a6b-fa56-44b0-be40-14429a67a2de None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:31.139604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 648/1338] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:31.148895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae280-9865-4400-9270-e784285991f8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:31.149433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae280-9865-4400-9270-e784285991f8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:31.149883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae280-9865-4400-9270-e784285991f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:31.245724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cf9ae280-9865-4400-9270-e784285991f8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:31.247015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf9ae280-9865-4400-9270-e784285991f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:31.527345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 691/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:31.839639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76645a6b-fa56-44b0-be40-14429a67a2de None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:31.842314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-76645a6b-fa56-44b0-be40-14429a67a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:31.956324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:31.988874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76645a6b-fa56-44b0-be40-14429a67a2de None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:32.077224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:32.077711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:32.078028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:32.078303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:32.079967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:32.223297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:32.224742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7876e4-586c-4dbd-ba92-18f2dd46c5f0 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:32.245399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 649/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:37.652452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc41a7-d7ec-48f4-8f15-bff31fb33651 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:37.653299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc41a7-d7ec-48f4-8f15-bff31fb33651 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:37.653299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc41a7-d7ec-48f4-8f15-bff31fb33651 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:37.654245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 692/1341] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:37.660091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd49d4-6859-431f-9b64-aa1d398c978c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:37.660906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd49d4-6859-431f-9b64-aa1d398c978c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:37.660906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd49d4-6859-431f-9b64-aa1d398c978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:37.666352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:37.752054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f3bd49d4-6859-431f-9b64-aa1d398c978c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:37.753362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f3bd49d4-6859-431f-9b64-aa1d398c978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:38.109649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 650/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:29:38.580768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc41a7-d7ec-48f4-8f15-bff31fb33651 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:38.582485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0ccc41a7-d7ec-48f4-8f15-bff31fb33651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:38.640014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:38.712217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc41a7-d7ec-48f4-8f15-bff31fb33651 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:38.826452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:38.827076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:38.827352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:38.827625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:38.829290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:38.991197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:39.014365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:39.016850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a91802-d034-481e-a73f-f7dfcb234d65 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:39.048894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 693/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:43.223992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8549b86-276b-4b30-b945-8671572d2dd3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:43.224638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8549b86-276b-4b30-b945-8671572d2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:43.225022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8549b86-276b-4b30-b945-8671572d2dd3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:43.227492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 651/1344] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:43.235993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc0f66-3bd3-4c35-8e0d-4904bb8b4f05 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:43.236789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc0f66-3bd3-4c35-8e0d-4904bb8b4f05 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:43.236992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc0f66-3bd3-4c35-8e0d-4904bb8b4f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:43.326961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-dcdc0f66-3bd3-4c35-8e0d-4904bb8b4f05 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:43.328268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dcdc0f66-3bd3-4c35-8e0d-4904bb8b4f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:43.455724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 694/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:29:43.749185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8549b86-276b-4b30-b945-8671572d2dd3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:43.750991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8549b86-276b-4b30-b945-8671572d2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:43.919293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:43.955787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8549b86-276b-4b30-b945-8671572d2dd3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:44.091449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:44.092466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:44.092951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:44.093419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:44.096449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:44.324943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:44.331948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d1587-f6aa-402a-91b9-d87cf6da7282 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:44.358346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 652/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:50.235759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2326-d20d-486e-b497-42b29dfada1d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:50.236484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2326-d20d-486e-b497-42b29dfada1d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:50.236484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad2326-d20d-486e-b497-42b29dfada1d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:50.238321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 695/1347] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:29:50.247339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688cc2-56e7-4187-b235-c6a664521fce None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:50.248056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688cc2-56e7-4187-b235-c6a664521fce None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:50.248304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688cc2-56e7-4187-b235-c6a664521fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:50.294874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:50.386463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8e688cc2-56e7-4187-b235-c6a664521fce None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:50.388440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e688cc2-56e7-4187-b235-c6a664521fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:50.538156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 653/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:29:50.887626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2326-d20d-486e-b497-42b29dfada1d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:29:50.890443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-68ad2326-d20d-486e-b497-42b29dfada1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:50.990411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:51.052274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad2326-d20d-486e-b497-42b29dfada1d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:29:51.150356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:29:51.151018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:51.151340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:51.151654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:51.154358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:51.343211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:51.351178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:29:51.354117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c5b80-ba34-4630-a64f-801132b13625 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:29:51.387595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 696/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:29:57.542303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859ca1-d783-43f4-82bb-a952164b1ea2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:57.544000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859ca1-d783-43f4-82bb-a952164b1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:57.544743 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3859ca1-d783-43f4-82bb-a952164b1ea2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:57.547582 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 654/1350] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:29:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:29:57.555843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea755-f9e8-4677-8474-9ba71287e857 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:29:57.556981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea755-f9e8-4677-8474-9ba71287e857 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:29:57.557494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea755-f9e8-4677-8474-9ba71287e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:29:57.726890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c74ea755-f9e8-4677-8474-9ba71287e857 None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:29:57.729043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c74ea755-f9e8-4677-8474-9ba71287e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:29:57.970217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 697/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:29:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:00.534707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=59 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:03.838714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e450-1902-4c96-900c-cbde5e7c5a8c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:03.839687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e450-1902-4c96-900c-cbde5e7c5a8c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:03.840114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1e450-1902-4c96-900c-cbde5e7c5a8c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:03.842032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 655/1352] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:03.851373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d3d6-e76f-4f4d-b096-50149b22c8d5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:03.852815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d3d6-e76f-4f4d-b096-50149b22c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:03.853967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5d3d6-e76f-4f4d-b096-50149b22c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:03.950179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:03.991816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8ee5d3d6-e76f-4f4d-b096-50149b22c8d5 None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:03.993456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ee5d3d6-e76f-4f4d-b096-50149b22c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:04.180170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 698/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:30:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:30:05.695366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cb525-c587-49a3-a755-3d042243249a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:05.695931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cb525-c587-49a3-a755-3d042243249a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:05.696271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cb525-c587-49a3-a755-3d042243249a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:05.698179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 656/1354] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:05.704039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d895-7b1b-4168-928a-3ff5586d469d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:05.704601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d895-7b1b-4168-928a-3ff5586d469d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:05.704760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d895-7b1b-4168-928a-3ff5586d469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:05.813167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4737d895-7b1b-4168-928a-3ff5586d469d None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:05.815257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4737d895-7b1b-4168-928a-3ff5586d469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:05.882352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:05.990451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 699/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:09.869926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542018-45c9-4a02-9d5b-1faf667e2f86 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:09.870567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542018-45c9-4a02-9d5b-1faf667e2f86 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:09.870689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68542018-45c9-4a02-9d5b-1faf667e2f86 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:09.872077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 657/1356] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:09.879378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5cb80-1cd1-4861-a978-bb448dea06d9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:09.879919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5cb80-1cd1-4861-a978-bb448dea06d9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:09.880196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5cb80-1cd1-4861-a978-bb448dea06d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:10.018178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-30f5cb80-1cd1-4861-a978-bb448dea06d9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:10.020637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-30f5cb80-1cd1-4861-a978-bb448dea06d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:10.185990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 700/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:10.658366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d89a1-40a1-47a0-9e35-e3e08693c51f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:10.659594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d89a1-40a1-47a0-9e35-e3e08693c51f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:10.660469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d89a1-40a1-47a0-9e35-e3e08693c51f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:10.663154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 658/1358] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 24 09:30:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:10.671891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006ec8-9e72-451a-9dc0-69749ba9abc4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:10.672209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006ec8-9e72-451a-9dc0-69749ba9abc4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:10.672562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f006ec8-9e72-451a-9dc0-69749ba9abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:10.702837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:10.782123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8f006ec8-9e72-451a-9dc0-69749ba9abc4 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:10.783413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8f006ec8-9e72-451a-9dc0-69749ba9abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:10.999746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 701/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 24 09:30:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:11.014489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d89a1-40a1-47a0-9e35-e3e08693c51f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:11.017756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dd7d89a1-40a1-47a0-9e35-e3e08693c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:11.282505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d89a1-40a1-47a0-9e35-e3e08693c51f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:11.408227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:11.502807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:11.504356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:11.504864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:11.505599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:11.509954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:11.670311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:11.671861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96027063-e88a-4660-b3d2-b8d1669a9a96 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:11.695761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 659/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:14.523796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645403-e8fa-401c-9f1d-c881a844b0af None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:14.524414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645403-e8fa-401c-9f1d-c881a844b0af None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:14.524685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645403-e8fa-401c-9f1d-c881a844b0af None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:14.534837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 702/1361] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:14.536450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914f01-991b-4e3d-a874-50316fd0efce None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:14.537624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914f01-991b-4e3d-a874-50316fd0efce None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:14.538130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb914f01-991b-4e3d-a874-50316fd0efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:14.633531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fb914f01-991b-4e3d-a874-50316fd0efce None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:14.635309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fb914f01-991b-4e3d-a874-50316fd0efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:14.685338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:14.764142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 660/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:15.286172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645403-e8fa-401c-9f1d-c881a844b0af None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:15.287919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70645403-e8fa-401c-9f1d-c881a844b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:15.388091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:15.495545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645403-e8fa-401c-9f1d-c881a844b0af None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:15.630742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:15.631429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:15.631670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:15.631944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:15.633577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:15.672391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:15.763497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:15.766300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcbf24-08b1-49a0-8f4e-5d34ba763532 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:15.795267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 703/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:18.767815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29618e5c-525b-4714-bf8b-87cf51d4363b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:18.769706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29618e5c-525b-4714-bf8b-87cf51d4363b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:18.770427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29618e5c-525b-4714-bf8b-87cf51d4363b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:18.776444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 661/1364] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:18.780752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494da56-db9c-4838-bd44-d0e858cf9546 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:18.782104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494da56-db9c-4838-bd44-d0e858cf9546 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:18.782104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494da56-db9c-4838-bd44-d0e858cf9546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:18.899656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a494da56-db9c-4838-bd44-d0e858cf9546 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:18.901593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a494da56-db9c-4838-bd44-d0e858cf9546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:19.083306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:19.090449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 704/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:30:19.625120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9aa9-909f-444f-bc66-af8622c7d5c2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:19.626673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9aa9-909f-444f-bc66-af8622c7d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:19.627202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9aa9-909f-444f-bc66-af8622c7d5c2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:19.629724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 662/1366] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 24 09:30:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:19.638533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17fb7-dc2f-4474-8f61-bf5e6e553f37 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:19.640512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17fb7-dc2f-4474-8f61-bf5e6e553f37 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:19.640512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17fb7-dc2f-4474-8f61-bf5e6e553f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:19.796656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-51e17fb7-dc2f-4474-8f61-bf5e6e553f37 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:19.799576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-51e17fb7-dc2f-4474-8f61-bf5e6e553f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:20.055049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 705/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 24 09:30:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:20.063349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9aa9-909f-444f-bc66-af8622c7d5c2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:20.065051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-956e9aa9-909f-444f-bc66-af8622c7d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:20.282930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9aa9-909f-444f-bc66-af8622c7d5c2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:20.310880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:20.482004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:20.483239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:20.483813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:20.484547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:20.490025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:20.636341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf6f6-9ee1-45ad-95bb-c31460a4755e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:20.636709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf6f6-9ee1-45ad-95bb-c31460a4755e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:20.637127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:20.637734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf6f6-9ee1-45ad-95bb-c31460a4755e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:20.638775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50030ec7-0d8f-432d-9ae1-d8206ad95150 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:20.639449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 706/1368] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:20.645835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5644ca-525e-46fb-bd2c-2366461769ca None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:20.646193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5644ca-525e-46fb-bd2c-2366461769ca None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:20.646416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5644ca-525e-46fb-bd2c-2366461769ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:20.672128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 663/1369] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:20.733278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:20.746103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8a5644ca-525e-46fb-bd2c-2366461769ca None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:20.747431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a5644ca-525e-46fb-bd2c-2366461769ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:20.905197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 707/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:21.596382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206649-47d5-4575-95e4-928e5a3059c0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:21.597646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206649-47d5-4575-95e4-928e5a3059c0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:21.597646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206649-47d5-4575-95e4-928e5a3059c0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:21.603441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 664/1371] 10.222.0.60 () {54 vars in 964 bytes} [Wed Aug 24 09:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:21.606450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d5782-451d-4ad5-926e-ecd7e7d6e6d0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:21.606652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d5782-451d-4ad5-926e-ecd7e7d6e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:21.606924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d5782-451d-4ad5-926e-ecd7e7d6e6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:21.735277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-916d5782-451d-4ad5-926e-ecd7e7d6e6d0 None None] MFA Rules not processed for user `af46b3972c53418e8932620410454643`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:21.737264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-916d5782-451d-4ad5-926e-ecd7e7d6e6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:21.838431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:21.847525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 708/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Aug 24 09:30:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:21.855170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206649-47d5-4575-95e4-928e5a3059c0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:21.856815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e2206649-47d5-4575-95e4-928e5a3059c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:21.889590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:22.010524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206649-47d5-4575-95e4-928e5a3059c0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:22.108377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:22.109101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:22.109446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:22.109733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:22.112657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:22.278735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:22.342811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:22.344619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60925a9-18f7-4174-b546-918e17f2edad service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:22.376137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 665/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:23.172686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60590ef-ac7d-4540-a9d3-ac2000456cbd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:23.173202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60590ef-ac7d-4540-a9d3-ac2000456cbd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:23.173202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60590ef-ac7d-4540-a9d3-ac2000456cbd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:23.175148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 709/1374] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:23.181664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e08433-53a4-4d98-a331-0a574327acee None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:23.182584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e08433-53a4-4d98-a331-0a574327acee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:23.182584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e08433-53a4-4d98-a331-0a574327acee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:23.285027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-38e08433-53a4-4d98-a331-0a574327acee None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:23.286968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-38e08433-53a4-4d98-a331-0a574327acee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:23.433354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 666/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:23.755261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60590ef-ac7d-4540-a9d3-ac2000456cbd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:23.756789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d60590ef-ac7d-4540-a9d3-ac2000456cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:23.965004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60590ef-ac7d-4540-a9d3-ac2000456cbd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:24.052223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:24.106555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:24.107170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:24.107451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:24.107761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:24.109393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:24.203708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:24.205369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643f42c-175d-434b-94df-0fa33ad31f4a service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:24.224465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 710/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:26.603328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eddd56-de9a-43ac-9798-c9f81eea2466 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:26.603922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eddd56-de9a-43ac-9798-c9f81eea2466 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:26.603922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eddd56-de9a-43ac-9798-c9f81eea2466 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:26.605249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 667/1377] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:26.611548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e33de-92ab-4ed2-9465-944991393f15 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:26.612971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e33de-92ab-4ed2-9465-944991393f15 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:26.613284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e33de-92ab-4ed2-9465-944991393f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:26.735149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a82e33de-92ab-4ed2-9465-944991393f15 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:26.736948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a82e33de-92ab-4ed2-9465-944991393f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:26.788858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:26.889449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 711/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:27.255625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eddd56-de9a-43ac-9798-c9f81eea2466 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:27.259197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-44eddd56-de9a-43ac-9798-c9f81eea2466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:27.301218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:27.461639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eddd56-de9a-43ac-9798-c9f81eea2466 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:27.608848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:27.616311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:27.617520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:27.618038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:27.618504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:27.620390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:27.734269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:27.736095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e7b4f-1dcb-4a7e-81af-b4024e96b000 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:27.755118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 668/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:30.081883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922560e-055c-40f4-8bae-5638f3bb8f64 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:30.082967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922560e-055c-40f4-8bae-5638f3bb8f64 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:30.083253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922560e-055c-40f4-8bae-5638f3bb8f64 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:30.084667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 712/1380] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:30.090602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842693-f8ce-4e23-9e9a-76f09dd285e0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:30.091131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842693-f8ce-4e23-9e9a-76f09dd285e0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:30.091131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842693-f8ce-4e23-9e9a-76f09dd285e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:30.177605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5f842693-f8ce-4e23-9e9a-76f09dd285e0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:30.179266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5f842693-f8ce-4e23-9e9a-76f09dd285e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:30.274928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:30.319422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 669/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:30.620859 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922560e-055c-40f4-8bae-5638f3bb8f64 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:30.627256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e922560e-055c-40f4-8bae-5638f3bb8f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:30.806747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922560e-055c-40f4-8bae-5638f3bb8f64 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:30.823893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:30.951469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:30.952089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:30.952373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:30.952649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:30.954844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:31.060993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:31.063336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8be937-4925-4612-9589-c230a1d2d0f5 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:31.086801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 713/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:33.639542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046cbc5-be93-4579-a432-81539818f4ad None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:33.640386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046cbc5-be93-4579-a432-81539818f4ad None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:33.640386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046cbc5-be93-4579-a432-81539818f4ad None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:33.642166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 670/1383] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:33.648953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb69d4-8351-439d-be49-43cd33eac040 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:33.649469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb69d4-8351-439d-be49-43cd33eac040 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:33.649759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb69d4-8351-439d-be49-43cd33eac040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:33.689522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:33.777504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2beb69d4-8351-439d-be49-43cd33eac040 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:33.778830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2beb69d4-8351-439d-be49-43cd33eac040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:33.923462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 714/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:34.231721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046cbc5-be93-4579-a432-81539818f4ad None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:34.233578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2046cbc5-be93-4579-a432-81539818f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:34.481122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046cbc5-be93-4579-a432-81539818f4ad None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:34.558191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:34.650618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:34.651442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:34.651442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:34.651641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:34.653290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:34.759244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:34.760891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc010e-63b1-4c1a-986f-9bc31af74c12 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:34.789110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 671/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:30:37.141133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829ce2-e48a-45ee-8a7e-99ca8cafc439 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:37.141818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829ce2-e48a-45ee-8a7e-99ca8cafc439 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:37.141818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829ce2-e48a-45ee-8a7e-99ca8cafc439 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:37.143617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 715/1386] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:37.149563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16941f3-80ea-4cf5-82b8-b0b6cf94947f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:37.150544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16941f3-80ea-4cf5-82b8-b0b6cf94947f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:37.150544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16941f3-80ea-4cf5-82b8-b0b6cf94947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:37.248523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e16941f3-80ea-4cf5-82b8-b0b6cf94947f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:37.251002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e16941f3-80ea-4cf5-82b8-b0b6cf94947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:37.267916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:37.446035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 672/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:30:37.777535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829ce2-e48a-45ee-8a7e-99ca8cafc439 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:37.779143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4f829ce2-e48a-45ee-8a7e-99ca8cafc439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:37.921651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:38.012188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829ce2-e48a-45ee-8a7e-99ca8cafc439 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:38.197290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:38.198492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:38.198492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:38.198845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:38.200555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:38.288861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:38.335913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:38.339012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeddbad-7e78-4991-aaaa-2b9c676e7ae4 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:38.381901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 716/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:40.231658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068dc3a-fd96-4121-b17b-cf224e189059 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:40.232538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068dc3a-fd96-4121-b17b-cf224e189059 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:40.232538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068dc3a-fd96-4121-b17b-cf224e189059 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:40.235788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 673/1389] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:40.244421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487bb4e-23f5-4847-a5cd-fd5bd79a5acd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:40.245015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487bb4e-23f5-4847-a5cd-fd5bd79a5acd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:40.245015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487bb4e-23f5-4847-a5cd-fd5bd79a5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:40.330607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9487bb4e-23f5-4847-a5cd-fd5bd79a5acd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:40.332341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9487bb4e-23f5-4847-a5cd-fd5bd79a5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:40.488851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 717/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:40.797722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc445b22-cf6f-40e0-b6ba-bcda4688a60b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:40.798137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc445b22-cf6f-40e0-b6ba-bcda4688a60b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:40.798416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc445b22-cf6f-40e0-b6ba-bcda4688a60b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:40.799842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 674/1391] 10.222.0.60 () {54 vars in 967 bytes} [Wed Aug 24 09:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:40.806175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:40.806652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:40.807159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:40.877849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:40.929344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] MFA Rules not processed for user `bef04835da9e450da45248746bb28fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:40.931568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:41.002551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626b61-7f01-4acc-9b01-a4d8c83abd2c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.002922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626b61-7f01-4acc-9b01-a4d8c83abd2c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.003332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78626b61-7f01-4acc-9b01-a4d8c83abd2c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.004989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 675/1392] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:41.011423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.011787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.012144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.068936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 718/1393] 10.222.0.60 () {58 vars in 1064 bytes} [Wed Aug 24 09:30:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:41.080321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:41.093525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ec184-0a7f-41ea-a3e4-a50718d69e09 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:41.105966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:41.107457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:41.196815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:41.197573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.198004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.198474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.200337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:41.261557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:41.283576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 676/1394] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:30:41.294101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:41.393123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:41.393427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6386-e0fd-4ff6-955e-965f39148c35 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:41.430381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 719/1395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:30:41.780043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:41.782625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:41.980075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae0ee2-b976-4d43-beb4-49ee0eaf07e5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:42.161130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:42.183966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:42.184602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:42.184873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:42.185146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:42.186920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:42.316147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:42.319301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f166a-7bf9-4770-a284-2d6d456a5272 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:42.343518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 677/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:42.662583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f95dcc-e8d1-4498-938c-41723acaf6ad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:42.663490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f95dcc-e8d1-4498-938c-41723acaf6ad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:42.663490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f95dcc-e8d1-4498-938c-41723acaf6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:42.788101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b4f95dcc-e8d1-4498-938c-41723acaf6ad None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:42.790180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b4f95dcc-e8d1-4498-938c-41723acaf6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:42.959361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 720/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:30:43.027516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bf4c8-5b24-4217-b306-b20abd8349c0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.027966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bf4c8-5b24-4217-b306-b20abd8349c0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.028551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bf4c8-5b24-4217-b306-b20abd8349c0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.030419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 678/1398] 10.222.0.60 () {54 vars in 943 bytes} [Wed Aug 24 09:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:43.039276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943fa87-2ad4-4f98-9ca0-65505307dc26 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.039773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943fa87-2ad4-4f98-9ca0-65505307dc26 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.040249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943fa87-2ad4-4f98-9ca0-65505307dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.075741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:43.163799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3943fa87-2ad4-4f98-9ca0-65505307dc26 None None] MFA Rules not processed for user `8c16b4dc236344ffa2ef8cab86d6594e`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:43.165740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3943fa87-2ad4-4f98-9ca0-65505307dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:43.349766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 721/1399] 10.222.0.60 () {58 vars in 1040 bytes} [Wed Aug 24 09:30:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:30:43.360373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bf4c8-5b24-4217-b306-b20abd8349c0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:43.362233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a79bf4c8-5b24-4217-b306-b20abd8349c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:43.563239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:43.617064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bf4c8-5b24-4217-b306-b20abd8349c0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:43.798598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:43.799618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.800101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.800382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.802190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:43.928501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:43.930219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227d44c-1291-4e1f-89ec-a48a4d2d8b6d service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:43.940437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 679/1400] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:30:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:30:44.898330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cd34d-713b-48f0-a4f4-9cfe131df5a8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.900171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cd34d-713b-48f0-a4f4-9cfe131df5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.900171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cd34d-713b-48f0-a4f4-9cfe131df5a8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.908142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 722/1401] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:44 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:44.912121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01e25-3fa5-4fc7-b72a-9e3e5f92281d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.912674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01e25-3fa5-4fc7-b72a-9e3e5f92281d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.912958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f01e25-3fa5-4fc7-b72a-9e3e5f92281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.933353 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:45.032744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1f01e25-3fa5-4fc7-b72a-9e3e5f92281d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:45.034856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1f01e25-3fa5-4fc7-b72a-9e3e5f92281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:45.216318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 680/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:45.644491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cd34d-713b-48f0-a4f4-9cfe131df5a8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:45.645332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-416cd34d-713b-48f0-a4f4-9cfe131df5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:45.838371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:45.979918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cd34d-713b-48f0-a4f4-9cfe131df5a8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:46.165109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:46.165893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:46.166182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:46.166459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:46.168105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:46.239812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:46.294700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:46.297769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c726-b185-4bbe-8df2-7a1c33be5e0c service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:46.324144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 723/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:48.657654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464d14-8f92-40cb-bbdc-2ea6e7f52c4b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.658684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464d14-8f92-40cb-bbdc-2ea6e7f52c4b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.658684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464d14-8f92-40cb-bbdc-2ea6e7f52c4b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.665402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 681/1404] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:48.673270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e853ee8-5014-4cd2-9be7-0d502c99e45a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.674086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e853ee8-5014-4cd2-9be7-0d502c99e45a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.674086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e853ee8-5014-4cd2-9be7-0d502c99e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.745827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3e853ee8-5014-4cd2-9be7-0d502c99e45a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:48.747086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3e853ee8-5014-4cd2-9be7-0d502c99e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:48.888063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 724/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:49.243995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464d14-8f92-40cb-bbdc-2ea6e7f52c4b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:49.246465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-88464d14-8f92-40cb-bbdc-2ea6e7f52c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:49.413331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:49.533835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464d14-8f92-40cb-bbdc-2ea6e7f52c4b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:49.727001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:49.728701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:49.729200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:49.729492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:49.731208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:49.803086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:49.858522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:49.860235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94137d7-2441-49cb-a627-fd2949bb21e5 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:49.887093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 682/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:30:52.794390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0fcf7-cfe0-4b77-9374-9dcae3749a9c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:52.801113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0fcf7-cfe0-4b77-9374-9dcae3749a9c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:52.801113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0fcf7-cfe0-4b77-9374-9dcae3749a9c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:52.801113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 725/1407] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:52.805026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81f25-c2d3-46ff-b2e3-18f90011636a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:52.805786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81f25-c2d3-46ff-b2e3-18f90011636a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:52.805786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81f25-c2d3-46ff-b2e3-18f90011636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:52.926118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-96e81f25-c2d3-46ff-b2e3-18f90011636a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:52.927865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-96e81f25-c2d3-46ff-b2e3-18f90011636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:53.098388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 683/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:30:53.386320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0fcf7-cfe0-4b77-9374-9dcae3749a9c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:53.389254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a7f0fcf7-cfe0-4b77-9374-9dcae3749a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:53.412371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:53.619873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0fcf7-cfe0-4b77-9374-9dcae3749a9c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:53.779267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:53.837232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:53.842017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:53.842017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:53.842017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:53.845849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:54.004551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:54.006210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eea991-0097-4721-a2c1-bc28f512d7f1 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:54.027525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 726/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:03.078610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:04.024457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=55 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:10.924722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a4d9-af30-4d06-a30b-387ff2cf14d5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.925634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a4d9-af30-4d06-a30b-387ff2cf14d5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.925745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a4d9-af30-4d06-a30b-387ff2cf14d5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:10.927825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 684/1410] 10.222.0.60 () {54 vars in 918 bytes} [Wed Aug 24 09:31:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:10.934752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b084bf-1b55-48f6-a6de-43ebdd10eae2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.936395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b084bf-1b55-48f6-a6de-43ebdd10eae2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.936395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b084bf-1b55-48f6-a6de-43ebdd10eae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.057265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-83b084bf-1b55-48f6-a6de-43ebdd10eae2 None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:11.058618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-83b084bf-1b55-48f6-a6de-43ebdd10eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:11.248273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 727/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 24 09:31:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:31:11.266779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac9a8-8033-447e-96b1-022bf8633f9b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.267125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac9a8-8033-447e-96b1-022bf8633f9b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.267319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac9a8-8033-447e-96b1-022bf8633f9b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.268690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 685/1412] 10.222.0.60 () {54 vars in 918 bytes} [Wed Aug 24 09:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:11.274076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3777-d374-482b-b410-9b0fcad51528 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.274369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3777-d374-482b-b410-9b0fcad51528 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.274623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3777-d374-482b-b410-9b0fcad51528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.364437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.367489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-95fc3777-d374-482b-b410-9b0fcad51528 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:11.369304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-95fc3777-d374-482b-b410-9b0fcad51528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:11.529303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 728/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 24 09:31:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:14.054142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814987-c4ff-43b1-9ae1-2a31864acde8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.054142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814987-c4ff-43b1-9ae1-2a31864acde8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.054142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac814987-c4ff-43b1-9ae1-2a31864acde8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.054142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 686/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:14.057686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680b29c-cd0c-40aa-84c6-ea6adacc9edd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.058167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680b29c-cd0c-40aa-84c6-ea6adacc9edd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.058394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680b29c-cd0c-40aa-84c6-ea6adacc9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.127460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e680b29c-cd0c-40aa-84c6-ea6adacc9edd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:14.128683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e680b29c-cd0c-40aa-84c6-ea6adacc9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:14.190079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.237346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 729/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:14.549414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814987-c4ff-43b1-9ae1-2a31864acde8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.551034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ac814987-c4ff-43b1-9ae1-2a31864acde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:14.726773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac814987-c4ff-43b1-9ae1-2a31864acde8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.802971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.847629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.848300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.848873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.849377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.851435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:14.943446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.945108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ceb08e-e02f-46ff-b2d6-0999ca905946 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.967988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 687/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:15.911471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9ddd8-ad37-459a-beec-85c9509daacb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.912063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9ddd8-ad37-459a-beec-85c9509daacb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.912063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9ddd8-ad37-459a-beec-85c9509daacb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:15.913350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 730/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:15.918698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e588-ad16-4499-adac-ca075e7d90d2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.919422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e588-ad16-4499-adac-ca075e7d90d2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.919422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e588-ad16-4499-adac-ca075e7d90d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.002334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d93e588-ad16-4499-adac-ca075e7d90d2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:16.003572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d93e588-ad16-4499-adac-ca075e7d90d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:16.031832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:16.121364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 688/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:16.280632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9ddd8-ad37-459a-beec-85c9509daacb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:16.282246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-65b9ddd8-ad37-459a-beec-85c9509daacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:16.447692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9ddd8-ad37-459a-beec-85c9509daacb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:16.499447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:16.586538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:16.587151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.587530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.587874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.589574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:16.709820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:16.711472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fffe3-65e9-4bd5-820d-20dae09cdcbe service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:16.730518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 731/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:17.655275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17444-9374-4b06-945c-672d06967771 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.655828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17444-9374-4b06-945c-672d06967771 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.655828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17444-9374-4b06-945c-672d06967771 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.657361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 689/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:17.663631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb9d6-a7b1-4fb3-80a3-797ab25ffd42 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.664200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb9d6-a7b1-4fb3-80a3-797ab25ffd42 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.664313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb9d6-a7b1-4fb3-80a3-797ab25ffd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.724503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:17.747108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-579cb9d6-a7b1-4fb3-80a3-797ab25ffd42 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:17.748343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-579cb9d6-a7b1-4fb3-80a3-797ab25ffd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:17.854528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 732/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:18.015402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17444-9374-4b06-945c-672d06967771 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.018202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fed17444-9374-4b06-945c-672d06967771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:18.187824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17444-9374-4b06-945c-672d06967771 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.201310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.312965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.313482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.313759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.314129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.315863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:18.425353 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.427045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d883dbb-9749-4b89-864f-7126fcba74b8 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.449213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 690/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:19.359217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d8546-e71b-4e8d-92dd-1dd4802114e2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.360014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d8546-e71b-4e8d-92dd-1dd4802114e2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.360014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d8546-e71b-4e8d-92dd-1dd4802114e2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.361182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 733/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:19.374705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddfda7-7c91-48d9-a96f-f75785b6df42 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.375490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddfda7-7c91-48d9-a96f-f75785b6df42 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.375490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddfda7-7c91-48d9-a96f-f75785b6df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.396532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:19.469371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1dddfda7-7c91-48d9-a96f-f75785b6df42 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:19.470686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1dddfda7-7c91-48d9-a96f-f75785b6df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:19.579489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 691/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:19.734248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d8546-e71b-4e8d-92dd-1dd4802114e2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:19.735818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-705d8546-e71b-4e8d-92dd-1dd4802114e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:19.870050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:19.912395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d8546-e71b-4e8d-92dd-1dd4802114e2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:20.055357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:20.056148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:20.056546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:20.056924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:20.058847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:20.155498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:20.170917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:20.172558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad242c20-bed2-4eef-8a9e-7b5ddd5f5728 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:20.193626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 734/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:31:21.130972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8245-81c5-4656-ba5a-4b7238743cfd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.131498 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8245-81c5-4656-ba5a-4b7238743cfd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.131498 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f8245-81c5-4656-ba5a-4b7238743cfd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.132769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 692/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:21.139331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f046c6-d153-4c37-8ee3-5dc641da0dbd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.139956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f046c6-d153-4c37-8ee3-5dc641da0dbd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.140275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f046c6-d153-4c37-8ee3-5dc641da0dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.231588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-00f046c6-d153-4c37-8ee3-5dc641da0dbd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:21.232882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-00f046c6-d153-4c37-8ee3-5dc641da0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:21.352951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 735/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:21.506028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f8245-81c5-4656-ba5a-4b7238743cfd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.507569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e3f8245-81c5-4656-ba5a-4b7238743cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:21.595507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.661640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f8245-81c5-4656-ba5a-4b7238743cfd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.792878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.794080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.794590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.795235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.797641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:21.863314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.916349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:21.917972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f22e1-9708-48ea-bb4b-c9cb3011658f service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:21.940499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 693/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:22.871128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d9b9-6c75-4eb4-9193-71d15bc66b59 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.872199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d9b9-6c75-4eb4-9193-71d15bc66b59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.872298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d9b9-6c75-4eb4-9193-71d15bc66b59 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.873965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 736/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:22.879592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0b358-9d9b-44fb-9ab4-bc51879bab78 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.880123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0b358-9d9b-44fb-9ab4-bc51879bab78 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.880123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0b358-9d9b-44fb-9ab4-bc51879bab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.986267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f4a0b358-9d9b-44fb-9ab4-bc51879bab78 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:22.987548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4a0b358-9d9b-44fb-9ab4-bc51879bab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:23.095291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 694/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:23.261200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d9b9-6c75-4eb4-9193-71d15bc66b59 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.262893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-96d0d9b9-6c75-4eb4-9193-71d15bc66b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:23.323986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.433787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d9b9-6c75-4eb4-9193-71d15bc66b59 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.577935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.578563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.578843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.579120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.580769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:23.588301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.680637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:23.682276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a57f58-7192-4d55-a3ab-e2fa3a084c2b service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:23.702688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 737/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:31:24.696514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad9ec-a033-483c-9323-aab93ec58708 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.697072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad9ec-a033-483c-9323-aab93ec58708 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.697254 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad9ec-a033-483c-9323-aab93ec58708 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.698526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 695/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:24.705142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b302-717e-433f-b159-a58d2849b1ad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.705663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b302-717e-433f-b159-a58d2849b1ad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.705782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b302-717e-433f-b159-a58d2849b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.787010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e4b9b302-717e-433f-b159-a58d2849b1ad None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:24.788274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e4b9b302-717e-433f-b159-a58d2849b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:24.860027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:24.891422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 738/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:31:25.049444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad9ec-a033-483c-9323-aab93ec58708 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.051118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f0aad9ec-a033-483c-9323-aab93ec58708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:25.075695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:25.242895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad9ec-a033-483c-9323-aab93ec58708 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.344257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:25.370768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.371605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.372151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.372427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.374089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:25.479301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.480943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d77b2-a0c6-46ba-b3c5-9e89ac9e3bdb service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.499960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 696/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:26.402828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3413b-d2af-4581-ad50-09d8a5149b44 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.403374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3413b-d2af-4581-ad50-09d8a5149b44 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.403590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3413b-d2af-4581-ad50-09d8a5149b44 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.404967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 739/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:26.410726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101426-a496-4ec2-8669-79071206671c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.412347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101426-a496-4ec2-8669-79071206671c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.412347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101426-a496-4ec2-8669-79071206671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.524263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-45101426-a496-4ec2-8669-79071206671c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:26.525483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45101426-a496-4ec2-8669-79071206671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:26.568906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:26.631411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 697/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:31:26.787861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3413b-d2af-4581-ad50-09d8a5149b44 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.789308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-63a3413b-d2af-4581-ad50-09d8a5149b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:26.948338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3413b-d2af-4581-ad50-09d8a5149b44 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:27.007209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.075151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:27.075791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:27.076065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:27.076384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:27.078304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:27.184365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:27.187023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71aa60-49ef-4624-8951-3935a948d1af service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:27.209506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 740/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:28.260250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76de95-02dc-4f38-a03e-d888beecb674 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.260975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76de95-02dc-4f38-a03e-d888beecb674 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.260975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76de95-02dc-4f38-a03e-d888beecb674 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.262213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 698/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:28.268724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daabbfc-7dd3-4718-89f4-59aac11fd6aa None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.269647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daabbfc-7dd3-4718-89f4-59aac11fd6aa None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.269647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daabbfc-7dd3-4718-89f4-59aac11fd6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.373148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7daabbfc-7dd3-4718-89f4-59aac11fd6aa None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:28.374504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7daabbfc-7dd3-4718-89f4-59aac11fd6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:28.376898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:28.505552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 741/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:28.670578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76de95-02dc-4f38-a03e-d888beecb674 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:28.672264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f76de95-02dc-4f38-a03e-d888beecb674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:28.882720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76de95-02dc-4f38-a03e-d888beecb674 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:28.921819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.054416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.055219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.055552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.055870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.057647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:29.176790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.179461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed9875-6f90-4e8f-bdf8-0bb6a5c2ccaa service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.201413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 699/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:31.148066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42327568-b010-4866-b8d6-42166f916791 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.148645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42327568-b010-4866-b8d6-42166f916791 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.148645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42327568-b010-4866-b8d6-42166f916791 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.149895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 742/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:31.157157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90a33-6f43-4c8b-8816-7f1ad0370b75 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.157761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90a33-6f43-4c8b-8816-7f1ad0370b75 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.157761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e90a33-6f43-4c8b-8816-7f1ad0370b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.210985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:31.249190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b1e90a33-6f43-4c8b-8816-7f1ad0370b75 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:31.250472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b1e90a33-6f43-4c8b-8816-7f1ad0370b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:31.370735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 700/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:31.707186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42327568-b010-4866-b8d6-42166f916791 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:31.710105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-42327568-b010-4866-b8d6-42166f916791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:31.847511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42327568-b010-4866-b8d6-42166f916791 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:31.884870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:31.935303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:31.935923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.936202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.936512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.938215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:32.081759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.083292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966908ff-f47a-4fbb-84a7-e6d7f7d675c9 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.104073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 743/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:34.354093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05970b-5e71-4d80-8190-3485ce88d51e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:34.355328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05970b-5e71-4d80-8190-3485ce88d51e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:34.355482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05970b-5e71-4d80-8190-3485ce88d51e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:34.357229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 701/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:34.363665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdaa8c-50d2-48d9-99ae-f62c7f307782 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:34.364523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdaa8c-50d2-48d9-99ae-f62c7f307782 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:34.364523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdaa8c-50d2-48d9-99ae-f62c7f307782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:34.459494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-04bdaa8c-50d2-48d9-99ae-f62c7f307782 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:34.460798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-04bdaa8c-50d2-48d9-99ae-f62c7f307782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:34.475402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:34.607196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 744/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:34.982677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05970b-5e71-4d80-8190-3485ce88d51e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:34.985388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2a05970b-5e71-4d80-8190-3485ce88d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:35.127077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05970b-5e71-4d80-8190-3485ce88d51e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:35.140478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:35.246920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:35.247491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.247727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.248006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.249762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:35.423031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:35.424490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85df8b-6222-4863-b1eb-7f7cc9df6a2f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:35.444508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 702/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:37.981219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381eb0-970e-4ab2-83db-51866078002f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.981913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381eb0-970e-4ab2-83db-51866078002f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.981913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381eb0-970e-4ab2-83db-51866078002f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.983156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 745/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:37.989293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c7a1d-eb9b-4ecf-8308-6239d398f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.989905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c7a1d-eb9b-4ecf-8308-6239d398f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.990070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c7a1d-eb9b-4ecf-8308-6239d398f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.054825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.077002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fd0c7a1d-eb9b-4ecf-8308-6239d398f4d6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:38.078259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fd0c7a1d-eb9b-4ecf-8308-6239d398f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:38.191898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 703/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:38.490599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381eb0-970e-4ab2-83db-51866078002f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.492339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8c381eb0-970e-4ab2-83db-51866078002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:38.626062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381eb0-970e-4ab2-83db-51866078002f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.683205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.725743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.726811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.727321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.727796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.730307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:38.907044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.909809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c9ed2-d7c4-420a-a045-ae0dc99479bb service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.943471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 746/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:41.310934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1e55-d766-488c-b8a8-db3875c82bc5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.311522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1e55-d766-488c-b8a8-db3875c82bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.311522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec1e55-d766-488c-b8a8-db3875c82bc5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.313099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 704/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:41.322091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e28da-692e-4de5-b544-176cbf31ada1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.322941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e28da-692e-4de5-b544-176cbf31ada1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.322941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e28da-692e-4de5-b544-176cbf31ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.432273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ad4e28da-692e-4de5-b544-176cbf31ada1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:41.433776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ad4e28da-692e-4de5-b544-176cbf31ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:41.463126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:41.581613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 747/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:31:41.896191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec1e55-d766-488c-b8a8-db3875c82bc5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.898147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8cec1e55-d766-488c-b8a8-db3875c82bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:42.023146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec1e55-d766-488c-b8a8-db3875c82bc5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.049080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.131501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.132604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.133018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.133489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.136833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:42.314598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.316110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e84a-bed7-421a-ba5b-4ad62c947ff7 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.338134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 705/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:44.534413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bda314-514c-4487-8ec9-b762945d680b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.535336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bda314-514c-4487-8ec9-b762945d680b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.535336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bda314-514c-4487-8ec9-b762945d680b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.536410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 748/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:44.543898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5112ee-b730-4c9e-b495-16afa685c1e5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.544479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5112ee-b730-4c9e-b495-16afa685c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.544823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5112ee-b730-4c9e-b495-16afa685c1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.668179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:44.672517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d5112ee-b730-4c9e-b495-16afa685c1e5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:44.673775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d5112ee-b730-4c9e-b495-16afa685c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:44.792837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 706/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:45.093346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bda314-514c-4487-8ec9-b762945d680b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:45.095843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-94bda314-514c-4487-8ec9-b762945d680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:45.239643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bda314-514c-4487-8ec9-b762945d680b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:45.317629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:45.346641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:45.347291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.347575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.347845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.349542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:45.507031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:45.509982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0066aa-6750-49fd-b9d9-e8f3df13000a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:45.539332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 749/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:31:47.642371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16339ae-9a2c-4067-861a-528505eebee7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.643035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16339ae-9a2c-4067-861a-528505eebee7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.643035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16339ae-9a2c-4067-861a-528505eebee7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.644286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 707/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:47.651743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1fd3b-66d8-4974-8d4d-df8fbdcc38f2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.652450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1fd3b-66d8-4974-8d4d-df8fbdcc38f2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.652627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1fd3b-66d8-4974-8d4d-df8fbdcc38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.739643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-03b1fd3b-66d8-4974-8d4d-df8fbdcc38f2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:47.740944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-03b1fd3b-66d8-4974-8d4d-df8fbdcc38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:47.773740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.857145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 750/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:31:48.146918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16339ae-9a2c-4067-861a-528505eebee7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.148716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b16339ae-9a2c-4067-861a-528505eebee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:48.264625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16339ae-9a2c-4067-861a-528505eebee7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.295231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.365583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.366113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.366396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.366670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.368367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:48.493809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.496332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecc719-b3f1-4663-9025-7e518b0118ae service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.518511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 708/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:50.658939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f06fe-17e4-4493-8444-627e701b32fd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:50.659797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f06fe-17e4-4493-8444-627e701b32fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:50.659797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f06fe-17e4-4493-8444-627e701b32fd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:50.660839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 751/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:50.666712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6550-07c6-46f5-b5f5-551310ebf62e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:50.667537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6550-07c6-46f5-b5f5-551310ebf62e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:50.667711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6550-07c6-46f5-b5f5-551310ebf62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:50.752070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-105d6550-07c6-46f5-b5f5-551310ebf62e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:50.753447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-105d6550-07c6-46f5-b5f5-551310ebf62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:50.763126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:50.874505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 709/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:51.162857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f06fe-17e4-4493-8444-627e701b32fd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:51.164447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-899f06fe-17e4-4493-8444-627e701b32fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:51.288917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f06fe-17e4-4493-8444-627e701b32fd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:51.350259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:51.371028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:51.371652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.371931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.372235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.373837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:51.493460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:51.495900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbf3b2-6ca3-49c1-8893-2e14d6a5cf29 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:51.517247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 752/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:53.673060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91b8b-f1e5-43fc-a21c-989fc45710d5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.673640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91b8b-f1e5-43fc-a21c-989fc45710d5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.673640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91b8b-f1e5-43fc-a21c-989fc45710d5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.675014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 710/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:53.683064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c618f-e5f0-4152-ac12-57db2b00f2be None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.683673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c618f-e5f0-4152-ac12-57db2b00f2be None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.684035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c618f-e5f0-4152-ac12-57db2b00f2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.762367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c26c618f-e5f0-4152-ac12-57db2b00f2be None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:53.763626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c26c618f-e5f0-4152-ac12-57db2b00f2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:53.816736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:53.889689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 753/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:54.235872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91b8b-f1e5-43fc-a21c-989fc45710d5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:54.237589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f6f91b8b-f1e5-43fc-a21c-989fc45710d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:54.355513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91b8b-f1e5-43fc-a21c-989fc45710d5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:54.401830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:54.444479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:54.445195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:54.445520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:54.445837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:54.448576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:54.594882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:54.596359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd5b77-86db-4602-9ac3-589e94a23840 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:54.624012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 711/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:31:56.744170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2004c-7e76-4d5e-9b38-c83d2001f850 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.744782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2004c-7e76-4d5e-9b38-c83d2001f850 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.744876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2004c-7e76-4d5e-9b38-c83d2001f850 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.746285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 754/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:56.753499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984515-a105-414e-a873-c963cc7ed5b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.754298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984515-a105-414e-a873-c963cc7ed5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.754520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984515-a105-414e-a873-c963cc7ed5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.844828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9f984515-a105-414e-a873-c963cc7ed5b9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:56.846181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9f984515-a105-414e-a873-c963cc7ed5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:56.866309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.975488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 712/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:31:57.272915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2004c-7e76-4d5e-9b38-c83d2001f850 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.275744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7ef2004c-7e76-4d5e-9b38-c83d2001f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:57.398089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2004c-7e76-4d5e-9b38-c83d2001f850 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.474252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.481665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.482393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.482717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.483071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.484897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:57.624183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.625814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7e6ea-2d45-4a80-8f9f-db3c2c749e57 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.656568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 755/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:31:59.722520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d29f-c1ea-4c7e-bce8-6d9af1feb8b6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.723249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d29f-c1ea-4c7e-bce8-6d9af1feb8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.723249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d29f-c1ea-4c7e-bce8-6d9af1feb8b6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.724422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 713/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:59.731279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566643c-85b8-41db-928c-41e974871044 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.731980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566643c-85b8-41db-928c-41e974871044 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.732109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566643c-85b8-41db-928c-41e974871044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.813782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7566643c-85b8-41db-928c-41e974871044 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:59.815820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7566643c-85b8-41db-928c-41e974871044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:59.893298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.962659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 756/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:00.284156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d29f-c1ea-4c7e-bce8-6d9af1feb8b6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.286993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e523d29f-c1ea-4c7e-bce8-6d9af1feb8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:00.423928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d29f-c1ea-4c7e-bce8-6d9af1feb8b6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.481482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:00.513552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.514192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.514475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.514748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.516424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:00.672613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.674577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d974ec3-11c0-4846-9cf8-e0ee180a2517 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.695759 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 714/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:32:09.959559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=22 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.693313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=66 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:22.228665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce4d1-6594-4170-b46d-ad963d389dbc None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.229410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce4d1-6594-4170-b46d-ad963d389dbc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.229640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce4d1-6594-4170-b46d-ad963d389dbc None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.231966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 757/1471] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:22.240638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73e13-d472-47ab-90bc-0d4d4d231ce8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.241983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73e13-d472-47ab-90bc-0d4d4d231ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.242176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73e13-d472-47ab-90bc-0d4d4d231ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.330134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-41c73e13-d472-47ab-90bc-0d4d4d231ce8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:22.331356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41c73e13-d472-47ab-90bc-0d4d4d231ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:22.464474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 715/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:32:22.803761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394e58-0ccf-4d60-abc5-29b0b9501e75 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.804048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394e58-0ccf-4d60-abc5-29b0b9501e75 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.804327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394e58-0ccf-4d60-abc5-29b0b9501e75 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.805734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 758/1473] 10.222.0.60 () {54 vars in 967 bytes} [Wed Aug 24 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:22.811191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd9f1-a30b-414c-a985-fef6ffe2366d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.811505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd9f1-a30b-414c-a985-fef6ffe2366d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.811790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd9f1-a30b-414c-a985-fef6ffe2366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.912624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3d3dd9f1-a30b-414c-a985-fef6ffe2366d None None] MFA Rules not processed for user `bef04835da9e450da45248746bb28fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:22.914042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3d3dd9f1-a30b-414c-a985-fef6ffe2366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:22.940801 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.024833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 716/1474] 10.222.0.60 () {58 vars in 1064 bytes} [Wed Aug 24 09:32:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:23.034418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394e58-0ccf-4d60-abc5-29b0b9501e75 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.039725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6f394e58-0ccf-4d60-abc5-29b0b9501e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:23.187756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394e58-0ccf-4d60-abc5-29b0b9501e75 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.284851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.285629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.285629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.285934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.287589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:23.357371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.423754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.425233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c3d88-3278-4469-9893-31c11a1938de service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.446469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 759/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:32:25.653358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a37aa-b6ea-4335-a3b0-7e398d709cbe None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.653997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a37aa-b6ea-4335-a3b0-7e398d709cbe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.653997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a37aa-b6ea-4335-a3b0-7e398d709cbe None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.655313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 717/1476] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:25.661973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfedf7-d07f-4bb3-939c-a878bf9ac942 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.662483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfedf7-d07f-4bb3-939c-a878bf9ac942 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.662961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfedf7-d07f-4bb3-939c-a878bf9ac942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.737810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a4bfedf7-d07f-4bb3-939c-a878bf9ac942 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:25.739086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a4bfedf7-d07f-4bb3-939c-a878bf9ac942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:25.860786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 760/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:26.181573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a37aa-b6ea-4335-a3b0-7e398d709cbe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.184399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eb4a37aa-b6ea-4335-a3b0-7e398d709cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:26.363955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a37aa-b6ea-4335-a3b0-7e398d709cbe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.445021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.512381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.513013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.513319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.513591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.514301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.516041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:32:26.516041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:32:26.516041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:32:26.522879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e21fe-9b03-45b0-8ac6-5c80f9786856 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.539263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 718/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/projects => generated 2553 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:32:28.782089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf2f6-d6ba-468f-a4fe-b57ed35fbdd6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.782711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf2f6-d6ba-468f-a4fe-b57ed35fbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.782956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf2f6-d6ba-468f-a4fe-b57ed35fbdd6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.785095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 761/1479] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:28.797017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedc8db-6d14-4e01-83f5-f2f64456bc37 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.797900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedc8db-6d14-4e01-83f5-f2f64456bc37 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.798092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedc8db-6d14-4e01-83f5-f2f64456bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.888683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1cedc8db-6d14-4e01-83f5-f2f64456bc37 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:28.889957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1cedc8db-6d14-4e01-83f5-f2f64456bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:29.005546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 719/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:29.307314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf2f6-d6ba-468f-a4fe-b57ed35fbdd6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:29.308879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-29baf2f6-d6ba-468f-a4fe-b57ed35fbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:29.320953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:29.490051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf2f6-d6ba-468f-a4fe-b57ed35fbdd6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:29.597734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:29.635497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:29.636154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.636473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.636796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.638488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:29.747703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:29.749288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7cd14-e065-44bb-9f3a-238fd9151f1b service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:29.768421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 762/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:32:32.081493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e473ac4-09d4-46c5-9c59-9dfd6a4ce2ac None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.082171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e473ac4-09d4-46c5-9c59-9dfd6a4ce2ac None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.082171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e473ac4-09d4-46c5-9c59-9dfd6a4ce2ac None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.083550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 720/1482] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:32.089952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200b237-3c4e-4192-aa20-33b05e292889 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.090671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200b237-3c4e-4192-aa20-33b05e292889 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.090671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200b237-3c4e-4192-aa20-33b05e292889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.165297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d200b237-3c4e-4192-aa20-33b05e292889 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:32.166543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d200b237-3c4e-4192-aa20-33b05e292889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:32.227637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.298022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 763/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:32.617076 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e473ac4-09d4-46c5-9c59-9dfd6a4ce2ac None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.618867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4e473ac4-09d4-46c5-9c59-9dfd6a4ce2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:32.652964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.767313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e473ac4-09d4-46c5-9c59-9dfd6a4ce2ac None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.865874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.866407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.866687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.866961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.868604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:32.969393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:33.011292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.012802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1718d7-e7f9-4db5-8fca-a22aae13cb72 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.037937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 721/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:32:35.171906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90897f-a09e-47ee-b1a9-6c46a3e844d7 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.172756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90897f-a09e-47ee-b1a9-6c46a3e844d7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.172756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90897f-a09e-47ee-b1a9-6c46a3e844d7 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.174995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 764/1485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:35.183987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32501-3656-40a9-bad2-5efcbd4928fd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.184556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32501-3656-40a9-bad2-5efcbd4928fd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.184973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb32501-3656-40a9-bad2-5efcbd4928fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.264951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fbb32501-3656-40a9-bad2-5efcbd4928fd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:35.266215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fbb32501-3656-40a9-bad2-5efcbd4928fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:35.377733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 722/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:35.673264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90897f-a09e-47ee-b1a9-6c46a3e844d7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.675886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4a90897f-a09e-47ee-b1a9-6c46a3e844d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:35.793220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90897f-a09e-47ee-b1a9-6c46a3e844d7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.893450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.895350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.895939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.897323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.897463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.899165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:36.037262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.038827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9a60f-2c52-470b-b043-49ce38399cc2 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.060353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 765/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:32:38.187784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f260-79b8-41d5-9716-c075a5960ce3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.188349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f260-79b8-41d5-9716-c075a5960ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.188473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f260-79b8-41d5-9716-c075a5960ce3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.189870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 723/1488] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:38.196462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ebf0-8c0f-4914-bde4-455cfa6dce57 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.197048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ebf0-8c0f-4914-bde4-455cfa6dce57 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.197048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ebf0-8c0f-4914-bde4-455cfa6dce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.276118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-25f2ebf0-8c0f-4914-bde4-455cfa6dce57 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:38.277335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-25f2ebf0-8c0f-4914-bde4-455cfa6dce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:38.343536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.393041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 766/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:38.695191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f260-79b8-41d5-9716-c075a5960ce3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:38.696992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c8c6f260-79b8-41d5-9716-c075a5960ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:38.736157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.819232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f260-79b8-41d5-9716-c075a5960ce3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:38.900957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:38.901568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.901845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.902149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.903754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:38.991266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:39.026159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:39.027641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d553ca0-9aa2-4b86-8cfe-7737fcfb3fb2 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:39.050119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 724/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:32:41.578110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4599-37a7-4dec-bf6b-46a039d8630d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.578742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4599-37a7-4dec-bf6b-46a039d8630d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.578742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4599-37a7-4dec-bf6b-46a039d8630d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.580167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 767/1491] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 24 09:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:41.586604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438532f2-5b05-44e3-bc3a-440ea1074e02 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.587125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438532f2-5b05-44e3-bc3a-440ea1074e02 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.587125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438532f2-5b05-44e3-bc3a-440ea1074e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.679550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-438532f2-5b05-44e3-bc3a-440ea1074e02 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:41.680820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-438532f2-5b05-44e3-bc3a-440ea1074e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:41.807305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 725/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:32:42.118356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4599-37a7-4dec-bf6b-46a039d8630d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:42.120010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c54d4599-37a7-4dec-bf6b-46a039d8630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:42.237026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4599-37a7-4dec-bf6b-46a039d8630d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:42.326230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:42.326851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:42.327239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:42.327534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:42.329259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:42.339851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:42.449363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:42.450763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac432ca-117e-4d8b-a62a-1c34a32f3cee service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:42.469966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 768/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:32:51.804918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=82 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:52.467450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=50 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:08.522648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:08.523402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:08.523631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:08.641065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:34:08.642321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:08.759298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 726/1494] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:34:08.769504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:08.770192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:08.770192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:08.790907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:34:08.792043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:08.801072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 769/1495] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:34:08.806495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:08.820057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4154fba-ecd0-4353-8206-9281c9cb0b4d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:08.825017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:08.826194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:08.826482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:08.826756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:08.827416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:34:08.827772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:08.828779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:08.828779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:34:08.828779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:34:08.829670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:08.843872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 727/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:34:08.852430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:08.861784 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404c8e3-8255-4d52-bc60-c7ad05f51bfe None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:08.866567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:08.867167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:08.867450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:08.867726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:08.868360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:08.870136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:08.870136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:34:08.870136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:34:08.871329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:09.023277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 770/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:34:08 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:34:09.030868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:09.054153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1bb9e-6bc7-4c48-a88d-a683d2bc6242 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:09.109264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:09.117751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:34:09.128664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:34:09.129615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:09.232124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 728/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:34:09 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:34:09.236864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:09.248628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c7f7-feff-4f49-b86d-02b414c8e66f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:09.253946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:09.254808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.255215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.255587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.256351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:09.257468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:09.257468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:34:09.257468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:34:09.258773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:09.272990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 771/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:34:09.280219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:09.291622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3e5bc-bc80-45cd-8db5-62ae96f25c77 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:09.297055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:09.297697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.298089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.298362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.299011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:09.300129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:09.300129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:34:09.300129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:34:09.301191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896fc57-e197-412c-a1f7-7aa516a193fb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:09.316844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 729/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:34:09.321238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:09.332278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e07c-3b04-4580-a4e5-a5b2bee1f701 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:09.337187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:09.337844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.338149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.338435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] PATH_INFO: `/v3/projects/8b05113ea3f946bba28846d1b21b6a6b/users/5ec1863a948d4fb19cd3f6e6c1e93789/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.353572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b05113ea3f946bba28846d1b21b6a6b, user_id=5ec1863a948d4fb19cd3f6e6c1e93789, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:09.354645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:09.354645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:34:09.354645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:34:09.357389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e404d9-8040-4423-94de-62f895613d91 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:09.433382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 772/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:34:09 2022] PUT /identity/v3/projects/8b05113ea3f946bba28846d1b21b6a6b/users/5ec1863a948d4fb19cd3f6e6c1e93789/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:34:09.446528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afcdc-11cd-42ec-8ce9-700fe07cd1b9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.446867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afcdc-11cd-42ec-8ce9-700fe07cd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.447156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afcdc-11cd-42ec-8ce9-700fe07cd1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.481392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-439afcdc-11cd-42ec-8ce9-700fe07cd1b9 None None] MFA Rules not processed for user `5ec1863a948d4fb19cd3f6e6c1e93789`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:34:09.483744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-439afcdc-11cd-42ec-8ce9-700fe07cd1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:09.567351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 730/1502] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:34:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:34:09.581093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d2c6a-b14a-49e7-88fb-7c6a53e58acd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.581416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d2c6a-b14a-49e7-88fb-7c6a53e58acd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.581697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d2c6a-b14a-49e7-88fb-7c6a53e58acd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.583160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 773/1503] 10.222.0.60 () {54 vars in 964 bytes} [Wed Aug 24 09:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:34:09.588486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671359-6312-44e4-ac62-590741618277 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.588826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671359-6312-44e4-ac62-590741618277 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.589064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671359-6312-44e4-ac62-590741618277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.659073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7c671359-6312-44e4-ac62-590741618277 None None] MFA Rules not processed for user `af46b3972c53418e8932620410454643`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:34:09.660316 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7c671359-6312-44e4-ac62-590741618277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:09.752083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 731/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Aug 24 09:34:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:34:09.762354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d2c6a-b14a-49e7-88fb-7c6a53e58acd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:09.777629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d2c6a-b14a-49e7-88fb-7c6a53e58acd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:09.785804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:09.785804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.785804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.785804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.793179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:09.795788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:09.805710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 774/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:34:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:34:09.865802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b88ae-20a0-4d07-88a9-2f2226e08abc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.866257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b88ae-20a0-4d07-88a9-2f2226e08abc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.866605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b88ae-20a0-4d07-88a9-2f2226e08abc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.868618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 732/1506] 10.222.0.60 () {52 vars in 830 bytes} [Wed Aug 24 09:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:34:09.874226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:09.958667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c96d-f94b-44a1-b33e-55c413f798d4 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:09.964397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:09.965332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:09.965797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:09.966874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] PATH_INFO: `/v3/users/5ec1863a948d4fb19cd3f6e6c1e93789` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:09.968723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec1863a948d4fb19cd3f6e6c1e93789)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:09.970569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:09.970569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:34:09.970569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:34:09.972959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:10.204568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec1863a948d4fb19cd3f6e6c1e93789'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:10.280700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec1863a948d4fb19cd3f6e6c1e93789'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:10.281596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec1863a948d4fb19cd3f6e6c1e93789'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:10.314052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec1863a948d4fb19cd3f6e6c1e93789'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:10.324932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec1863a948d4fb19cd3f6e6c1e93789'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:10.327284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:10.339337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 775/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:34:09 2022] DELETE /identity/v3/users/5ec1863a948d4fb19cd3f6e6c1e93789 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:34:10.344764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:10.345051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:10.345329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:10.365577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:34:10.366812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:10.377253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:10.437357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 733/1508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:34:10.447540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:10.449328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:10.544508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df7a32-497d-4277-810b-c9d51db87276 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:10.550726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff2ed3-f180-4ddd-8a49-8c347abf8afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:10.551761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2ed3-f180-4ddd-8a49-8c347abf8afe service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:10.552252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2ed3-f180-4ddd-8a49-8c347abf8afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:10.552846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff2ed3-f180-4ddd-8a49-8c347abf8afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:10.569262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff2ed3-f180-4ddd-8a49-8c347abf8afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:10.571906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff2ed3-f180-4ddd-8a49-8c347abf8afe service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:10.583720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 776/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:34:11.117124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:11.119361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:11.139226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc9d96-603a-40e8-bf4c-2e785f2e2932 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:11.145305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:11.146070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:11.146357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:11.146633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] PATH_INFO: `/v3/projects/8b05113ea3f946bba28846d1b21b6a6b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:11.147826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b05113ea3f946bba28846d1b21b6a6b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:11.148857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:34:11.148857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:34:11.148857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:34:11.150130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:11.295098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b05113ea3f946bba28846d1b21b6a6b', 'request_id': 'req-515cd11f-d243-4780-aab9-355149715f12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:11.301597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b05113ea3f946bba28846d1b21b6a6b', 'request_id': 'req-515cd11f-d243-4780-aab9-355149715f12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:11.400042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b05113ea3f946bba28846d1b21b6a6b', 'request_id': 'req-515cd11f-d243-4780-aab9-355149715f12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:11.421739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] The token cache is being invalidate because project 8b05113ea3f946bba28846d1b21b6a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:34:11.422061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:11.422845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-515cd11f-d243-4780-aab9-355149715f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:34:11.424374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 734/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:34:11 2022] DELETE /identity/v3/projects/8b05113ea3f946bba28846d1b21b6a6b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:34:20.578186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=38 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:21.417398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:46.996145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f219-89f8-4fad-ad36-9fe2e430c27b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:46.998759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f219-89f8-4fad-ad36-9fe2e430c27b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:46.998759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f219-89f8-4fad-ad36-9fe2e430c27b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:46.998759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 777/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:47.004144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bcf06-3a3f-4e04-82e1-81302f7f59f7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:47.004737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bcf06-3a3f-4e04-82e1-81302f7f59f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:47.004737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bcf06-3a3f-4e04-82e1-81302f7f59f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:47.034958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8e5bcf06-3a3f-4e04-82e1-81302f7f59f7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:47.038064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e5bcf06-3a3f-4e04-82e1-81302f7f59f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:47.109567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 735/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:35:47.269433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f219-89f8-4fad-ad36-9fe2e430c27b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:47.271480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ced7f219-89f8-4fad-ad36-9fe2e430c27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:47.388581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f219-89f8-4fad-ad36-9fe2e430c27b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:47.394382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4794a94-72e6-43a6-8da0-40dc86670aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:47.395067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794a94-72e6-43a6-8da0-40dc86670aae service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:47.395462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794a94-72e6-43a6-8da0-40dc86670aae service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:47.395852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4794a94-72e6-43a6-8da0-40dc86670aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:47.409831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794a94-72e6-43a6-8da0-40dc86670aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:47.412968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4794a94-72e6-43a6-8da0-40dc86670aae service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:47.425367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 778/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:35:48.281981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495af4-ded3-4143-861a-6615fe029a08 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:48.282849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495af4-ded3-4143-861a-6615fe029a08 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:48.282849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495af4-ded3-4143-861a-6615fe029a08 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:48.284071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 736/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:48.289344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78ea9-9f63-4451-a93b-ebc918177c6c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:48.289822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78ea9-9f63-4451-a93b-ebc918177c6c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:48.289822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78ea9-9f63-4451-a93b-ebc918177c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:48.310331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-edc78ea9-9f63-4451-a93b-ebc918177c6c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:48.311581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-edc78ea9-9f63-4451-a93b-ebc918177c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:48.320588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 779/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:35:48.480998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19495af4-ded3-4143-861a-6615fe029a08 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:48.498047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19495af4-ded3-4143-861a-6615fe029a08 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:48.506273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d79d0-e158-47ad-9e9e-aacf4d756081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:48.507328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d79d0-e158-47ad-9e9e-aacf4d756081 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:48.508087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d79d0-e158-47ad-9e9e-aacf4d756081 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:48.508592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d79d0-e158-47ad-9e9e-aacf4d756081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:48.522794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d79d0-e158-47ad-9e9e-aacf4d756081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:48.524428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d79d0-e158-47ad-9e9e-aacf4d756081 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:48.535015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 737/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:35:48.695475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9aa3a-36c1-4cb2-ac9c-a5d998fa74c8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:48.695854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9aa3a-36c1-4cb2-ac9c-a5d998fa74c8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:48.696180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9aa3a-36c1-4cb2-ac9c-a5d998fa74c8 None None] PATH_INFO: `/v3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:48.697534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 780/1517] 10.222.0.27 () {54 vars in 925 bytes} [Wed Aug 24 09:35:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:48.707202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063edabf-bd8b-47d1-83e4-cb623d722bdc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:48.707487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063edabf-bd8b-47d1-83e4-cb623d722bdc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:48.707764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063edabf-bd8b-47d1-83e4-cb623d722bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:48.761547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-063edabf-bd8b-47d1-83e4-cb623d722bdc None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:48.762726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-063edabf-bd8b-47d1-83e4-cb623d722bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:48.846696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 738/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:35:57.794900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d79cf-81ba-4a27-9616-4f0d8bdce83d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:57.795438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d79cf-81ba-4a27-9616-4f0d8bdce83d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:57.795438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d79cf-81ba-4a27-9616-4f0d8bdce83d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:57.796660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 781/1519] 10.222.0.60 () {54 vars in 961 bytes} [Wed Aug 24 09:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:57.803420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204989e7-cbc8-40c7-8939-d3dc7755df31 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:57.803897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204989e7-cbc8-40c7-8939-d3dc7755df31 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:57.804004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204989e7-cbc8-40c7-8939-d3dc7755df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:57.824820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-204989e7-cbc8-40c7-8939-d3dc7755df31 None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:57.825534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-204989e7-cbc8-40c7-8939-d3dc7755df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:57.834495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 739/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Aug 24 09:35:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:35:57.842142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d79cf-81ba-4a27-9616-4f0d8bdce83d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:57.857091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d79cf-81ba-4a27-9616-4f0d8bdce83d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:57.862946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8982d9-3d92-40a8-9ffc-10f80ef9126f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:57.863554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8982d9-3d92-40a8-9ffc-10f80ef9126f service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:57.863837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8982d9-3d92-40a8-9ffc-10f80ef9126f service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:57.864112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8982d9-3d92-40a8-9ffc-10f80ef9126f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:57.872677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8982d9-3d92-40a8-9ffc-10f80ef9126f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:57.874297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8982d9-3d92-40a8-9ffc-10f80ef9126f service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:57.884845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 782/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:35:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:35:59.795787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9f89e-31ea-4b7e-8b4f-42cc3a9c697c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:59.796388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9f89e-31ea-4b7e-8b4f-42cc3a9c697c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:59.796388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9f89e-31ea-4b7e-8b4f-42cc3a9c697c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:59.798460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 740/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:59.803535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd497d8-9bdf-4929-a4c5-4bb7d91af46a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:59.803986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd497d8-9bdf-4929-a4c5-4bb7d91af46a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:59.804155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd497d8-9bdf-4929-a4c5-4bb7d91af46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:59.824044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ffd497d8-9bdf-4929-a4c5-4bb7d91af46a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:59.825244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ffd497d8-9bdf-4929-a4c5-4bb7d91af46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:59.833548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 783/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:35:59.989886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9f89e-31ea-4b7e-8b4f-42cc3a9c697c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:00.006023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9f89e-31ea-4b7e-8b4f-42cc3a9c697c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:00.013000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984b2d-3e41-4724-b18f-b08c00b52557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:00.018097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984b2d-3e41-4724-b18f-b08c00b52557 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:00.018097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984b2d-3e41-4724-b18f-b08c00b52557 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:00.018097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984b2d-3e41-4724-b18f-b08c00b52557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:00.023234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984b2d-3e41-4724-b18f-b08c00b52557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:00.024826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984b2d-3e41-4724-b18f-b08c00b52557 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:00.037041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 741/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:36:00.872501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093c737-5dd8-467a-a140-78c5f40122ce None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:00.873385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093c737-5dd8-467a-a140-78c5f40122ce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:00.873385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093c737-5dd8-467a-a140-78c5f40122ce None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:00.874385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 784/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:00.880193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb89c-1649-488b-a4d9-d0544be7940e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:00.880869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb89c-1649-488b-a4d9-d0544be7940e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:00.880869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb89c-1649-488b-a4d9-d0544be7940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:00.903435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-58aeb89c-1649-488b-a4d9-d0544be7940e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:00.904635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58aeb89c-1649-488b-a4d9-d0544be7940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:00.912933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 742/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:01.067527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093c737-5dd8-467a-a140-78c5f40122ce None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:01.082392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093c737-5dd8-467a-a140-78c5f40122ce None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:01.087719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7111d6-19d5-4e40-9d8b-98e90e784a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:01.088315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7111d6-19d5-4e40-9d8b-98e90e784a5b service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:01.088592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7111d6-19d5-4e40-9d8b-98e90e784a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:01.088864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7111d6-19d5-4e40-9d8b-98e90e784a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:01.098405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7111d6-19d5-4e40-9d8b-98e90e784a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:01.099978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7111d6-19d5-4e40-9d8b-98e90e784a5b service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:01.110085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 785/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:04.963506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02ed7-23c0-4131-a1a3-caeb40baccd3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:04.964190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02ed7-23c0-4131-a1a3-caeb40baccd3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:04.964436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02ed7-23c0-4131-a1a3-caeb40baccd3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:04.966898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 743/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:04.975428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c3ae9-a1b0-4519-8bdf-271a4dab0f02 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:04.975939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c3ae9-a1b0-4519-8bdf-271a4dab0f02 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:04.976054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c3ae9-a1b0-4519-8bdf-271a4dab0f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:04.997528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-845c3ae9-a1b0-4519-8bdf-271a4dab0f02 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:04.998782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-845c3ae9-a1b0-4519-8bdf-271a4dab0f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:05.007146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 786/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:05.297004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02ed7-23c0-4131-a1a3-caeb40baccd3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:05.299313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87b02ed7-23c0-4131-a1a3-caeb40baccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:05.336950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:05.368158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02ed7-23c0-4131-a1a3-caeb40baccd3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:05.372490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04246a0-fd74-43e7-8324-bf40d8343444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:05.373225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04246a0-fd74-43e7-8324-bf40d8343444 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:05.373892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04246a0-fd74-43e7-8324-bf40d8343444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:05.374229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04246a0-fd74-43e7-8324-bf40d8343444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:05.384940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04246a0-fd74-43e7-8324-bf40d8343444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:05.386431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04246a0-fd74-43e7-8324-bf40d8343444 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:05.396865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 744/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:07.398986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f93396-8c27-4bfb-8d36-6ad69218e88b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:07.399876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f93396-8c27-4bfb-8d36-6ad69218e88b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:07.399876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f93396-8c27-4bfb-8d36-6ad69218e88b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:07.400947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 787/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:07.407485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6aa2a-8d03-46cc-8efd-d8cda6153255 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:07.408313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6aa2a-8d03-46cc-8efd-d8cda6153255 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:07.408313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6aa2a-8d03-46cc-8efd-d8cda6153255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:07.428411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a8f6aa2a-8d03-46cc-8efd-d8cda6153255 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:07.429634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a8f6aa2a-8d03-46cc-8efd-d8cda6153255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:07.438294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 745/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:36:07.734957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f93396-8c27-4bfb-8d36-6ad69218e88b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:07.748548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f93396-8c27-4bfb-8d36-6ad69218e88b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:07.752921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19eb8a-af02-4f36-a70b-78e424f31ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:07.753532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19eb8a-af02-4f36-a70b-78e424f31ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:07.753816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19eb8a-af02-4f36-a70b-78e424f31ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:07.754129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19eb8a-af02-4f36-a70b-78e424f31ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:07.764409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19eb8a-af02-4f36-a70b-78e424f31ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:07.766587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19eb8a-af02-4f36-a70b-78e424f31ab8 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:07.776951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 788/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:36:11.484786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6433f7-fef8-4c55-b905-8d12ae74ff20 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:11.485344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6433f7-fef8-4c55-b905-8d12ae74ff20 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:11.485344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6433f7-fef8-4c55-b905-8d12ae74ff20 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:11.486843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 746/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:11.492502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8b0bb-bbfd-4f1b-9a6e-88bc51eb43e8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:11.492985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8b0bb-bbfd-4f1b-9a6e-88bc51eb43e8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:11.493085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8b0bb-bbfd-4f1b-9a6e-88bc51eb43e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:11.503142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=74 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:11.515355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bea8b0bb-bbfd-4f1b-9a6e-88bc51eb43e8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:11.519444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bea8b0bb-bbfd-4f1b-9a6e-88bc51eb43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:11.525500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 789/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:36:12.088543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6433f7-fef8-4c55-b905-8d12ae74ff20 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:12.090243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0d6433f7-fef8-4c55-b905-8d12ae74ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:12.149492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6433f7-fef8-4c55-b905-8d12ae74ff20 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:12.153071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa83c63-5271-46fd-8ae7-bc28e05454b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:12.153676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa83c63-5271-46fd-8ae7-bc28e05454b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:12.153984 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa83c63-5271-46fd-8ae7-bc28e05454b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:12.154258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa83c63-5271-46fd-8ae7-bc28e05454b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:12.163683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa83c63-5271-46fd-8ae7-bc28e05454b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:12.165102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa83c63-5271-46fd-8ae7-bc28e05454b1 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:12.175134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 747/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:14.155972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46a98-2a0b-4eec-83e7-d4466666e24c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:14.156531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46a98-2a0b-4eec-83e7-d4466666e24c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:14.156632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf46a98-2a0b-4eec-83e7-d4466666e24c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:14.157976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 790/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:14.163510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89555-17a3-425d-948e-a253c67d1536 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:14.163956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89555-17a3-425d-948e-a253c67d1536 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:14.164091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89555-17a3-425d-948e-a253c67d1536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:14.184189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b6a89555-17a3-425d-948e-a253c67d1536 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:14.185396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6a89555-17a3-425d-948e-a253c67d1536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:14.194059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 748/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:14.777548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf46a98-2a0b-4eec-83e7-d4466666e24c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:14.779318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0cf46a98-2a0b-4eec-83e7-d4466666e24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:14.793971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf46a98-2a0b-4eec-83e7-d4466666e24c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:14.797752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7664b-2285-48fc-a9a7-f0942c35e685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:14.798392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7664b-2285-48fc-a9a7-f0942c35e685 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:14.798694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7664b-2285-48fc-a9a7-f0942c35e685 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:14.798964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7664b-2285-48fc-a9a7-f0942c35e685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:14.808567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7664b-2285-48fc-a9a7-f0942c35e685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:14.810033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7664b-2285-48fc-a9a7-f0942c35e685 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:14.820555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 791/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:36:24.179475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=47 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:24.815924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=8 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:43.272683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85694e9-7bec-44f6-838e-e30488f1f3d0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.274251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85694e9-7bec-44f6-838e-e30488f1f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.274850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85694e9-7bec-44f6-838e-e30488f1f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.304102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e85694e9-7bec-44f6-838e-e30488f1f3d0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.305453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e85694e9-7bec-44f6-838e-e30488f1f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.318517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5872b-1d0c-4cba-8e03-fb8f74044c37 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.319150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5872b-1d0c-4cba-8e03-fb8f74044c37 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.319150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5872b-1d0c-4cba-8e03-fb8f74044c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.319513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 749/1540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.330273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.330666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.331010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.360049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-79f5872b-1d0c-4cba-8e03-fb8f74044c37 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.361295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-79f5872b-1d0c-4cba-8e03-fb8f74044c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.361897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.363202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.381433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 792/1541] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.387641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 750/1542] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.391758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.392018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.392302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.393907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:43.404160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5ea17-4cfb-474a-851e-a68bb0a38763 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:43.427755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:43.428427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.428755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.428985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.429435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.429653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:43.430033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:43.430840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.431745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4511da-58d3-4206-a57c-79c0fa638320 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:43.449680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 793/1543] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.454956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:43.465142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 751/1544] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:43.470454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814fff2-bcda-4dd6-b8b7-5ac07e500f55 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:43.478844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.479122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.479458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.481901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:43.482544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.482827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.483101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.484207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:43.484505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:43.485621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:37:43.485621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:37:43.485621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:37:43.486887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:43.512936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 794/1545] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:37:43.514188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:43.523833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.525044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.534678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02152a-99a8-4d34-8c0b-89595d0e3340 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:43.545518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230cd6-4492-4edc-b933-1bbea9ba5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:43.546569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 752/1546] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:37:43.546767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230cd6-4492-4edc-b933-1bbea9ba5f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.546927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230cd6-4492-4edc-b933-1bbea9ba5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.547101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230cd6-4492-4edc-b933-1bbea9ba5f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.547714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230cd6-4492-4edc-b933-1bbea9ba5f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:43.548071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:43.555164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230cd6-4492-4edc-b933-1bbea9ba5f76 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:43.569944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d5c7-1573-43ff-aeac-cf5e4d13fe74 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:43.588810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:37:43.597093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:37:43.597668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516448e-3ccb-4279-8b97-969daefd75e8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:43.696962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 795/1547] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:43.698895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138887-8232-4fdd-9c09-cc47a33a28f8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.699185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138887-8232-4fdd-9c09-cc47a33a28f8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.699465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138887-8232-4fdd-9c09-cc47a33a28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.721634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4a138887-8232-4fdd-9c09-cc47a33a28f8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.724956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4a138887-8232-4fdd-9c09-cc47a33a28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.737561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 753/1548] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:43.738865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.739156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.739436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.786735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.788068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.802242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 796/1549] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.804349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfa2f4-293d-47de-bd11-1cbdcced54c7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.804829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfa2f4-293d-47de-bd11-1cbdcced54c7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.805302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfa2f4-293d-47de-bd11-1cbdcced54c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.829598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-39cfa2f4-293d-47de-bd11-1cbdcced54c7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.834237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-39cfa2f4-293d-47de-bd11-1cbdcced54c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.869787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 754/1550] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.870683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:43.885087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e143e-aa36-4d24-84ab-eb93ebd49807 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:43.893192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d3a8c-541b-4b19-8547-e624572b2ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:43.896967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d3a8c-541b-4b19-8547-e624572b2ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.896967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d3a8c-541b-4b19-8547-e624572b2ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.896967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d3a8c-541b-4b19-8547-e624572b2ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.896967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d3a8c-541b-4b19-8547-e624572b2ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:43.899805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d3a8c-541b-4b19-8547-e624572b2ac4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:43.901932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 797/1551] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.901932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.902560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.902845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.925090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.930358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.934518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 798/1552] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.935402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:43.947651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54613c-acb9-4e18-91ac-2a392d8bb3c6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:43.954123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:43.954756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.955035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.955309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.956691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:43.956973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:37:43.956973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:37:43.956973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:37:43.958278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7afb9-c6e6-43fa-8e9e-5192e3e800d4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.013811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 755/1553] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.015822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.016111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.016411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.036934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.038120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.046646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 756/1554] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.047654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.057819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db32fab-28d8-45c1-9499-64198d3c4422 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.062834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.063446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.063731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.064010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.064707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:44.064997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.066676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4e8bb-dd42-4f66-ab2b-07c982f6448c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.080652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 757/1555] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:44.091858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4d949-0790-4c54-805e-380f742f37e9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.091858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4d949-0790-4c54-805e-380f742f37e9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.091858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4d949-0790-4c54-805e-380f742f37e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.103652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-57f4d949-0790-4c54-805e-380f742f37e9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.104863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-57f4d949-0790-4c54-805e-380f742f37e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.113360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 758/1556] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.114691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343bd7-ae8e-47a3-9ebe-a07a7144225c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.114991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343bd7-ae8e-47a3-9ebe-a07a7144225c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.115253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343bd7-ae8e-47a3-9ebe-a07a7144225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.122998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 799/1557] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.124904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.131921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.131921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.139145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ca343bd7-ae8e-47a3-9ebe-a07a7144225c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.140486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ca343bd7-ae8e-47a3-9ebe-a07a7144225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.145209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.146565 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.149157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 759/1558] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.150403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae306b-96a0-4379-8d75-e646525ce7ef None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.150691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae306b-96a0-4379-8d75-e646525ce7ef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.150970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae306b-96a0-4379-8d75-e646525ce7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.157314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 800/1559] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.161528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.171876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8dab0-5a4f-45af-a8b6-c9b779304eed None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.176243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1cae306b-96a0-4379-8d75-e646525ce7ef None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.176404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.177011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.177304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.177511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1cae306b-96a0-4379-8d75-e646525ce7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.177634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.178269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.179860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.190237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 760/1560] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.190237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b82ee-822b-4c3a-b81c-efad27b73797 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.190237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b82ee-822b-4c3a-b81c-efad27b73797 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.190237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b82ee-822b-4c3a-b81c-efad27b73797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.192230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 801/1561] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:44.193096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.203913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379efb-0d77-47cf-9391-5e278d33bccb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.209479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.209479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.209937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.210195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a00b82ee-822b-4c3a-b81c-efad27b73797 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.210312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.210543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.211102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a00b82ee-822b-4c3a-b81c-efad27b73797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.212522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.219872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 761/1562] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.223258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.223642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.223933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.224127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.244860 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.246148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.254453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 762/1563] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.258229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.264552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3171a2-38d0-44bf-86db-a00f38e0e0cb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.271845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.271845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.271845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.271845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.272957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.272957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.284011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 763/1564] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:44.284952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.300325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e09af-63fd-4756-ad91-6cb226ff5dc4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.300523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 802/1565] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.301216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.304728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.305343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.305650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.305960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.306613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:44.306921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.308554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.320971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 764/1566] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:44.321779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.332289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fec2d-35c2-4497-95d6-5aec80c46d39 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.340620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.366739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77086c4-f398-4948-afd4-85f77783f578 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.375853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.376511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.376791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.377064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.377759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:44.378096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.380590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.398031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 803/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:44.398031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.399965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.400923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.401405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.401782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.402839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:44.403142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.404748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.408551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121433f-7fdb-4f00-9bd6-838d3a6f2802 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.412878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.413472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.413752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.414055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.414694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.416297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.427931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 765/1568] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:44.427931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.428272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 804/1569] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:44.430965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.433949 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639fc15-3b51-4389-9c64-a775326e3ab0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.439122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.439732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.440036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.440368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.440816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce0e7-3010-4f41-82f4-c89608e52748 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.441029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:44.441363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.442997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.445743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.446013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.446296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.446573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.447221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:37:44.447528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.449093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.461283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 766/1570] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:44.461283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.466563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 805/1571] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:37:44.467501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.469394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18ae9-12c8-48a8-b186-d189b40b30de admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.474414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.475079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.475358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.475627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.476269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.477893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.479641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdd372-a9d3-439e-998c-adb020012a67 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.485145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.485746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.486065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.486344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.486969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.488868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.489216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 767/1572] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:44.492723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.503190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d959c5b-e08a-4820-8c9b-e487fd98b4bf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.508709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.512374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.512374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.512374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.512374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.512374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.605828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 806/1573] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.606708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.616593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03596969-5dba-4947-b1f5-6f84ebc3ed23 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.621234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.621787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.622100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.622372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.623013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.625250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.631191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 768/1574] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.633537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.701505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c290b7-9729-4b18-a3ad-e59721c00109 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.706738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.707407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.707690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.707965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.708598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.710626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.725449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 807/1575] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.725449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.786574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24879e-fe3e-4454-b382-ba68240e395b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.791329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.791997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.792272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.792552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] PATH_INFO: `/v3/projects/34ceb3d97e6d4579b45231db6d0aa7ee/users/b498e100c357430cbe953fab1a7eb354/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.807510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ceb3d97e6d4579b45231db6d0aa7ee, user_id=b498e100c357430cbe953fab1a7eb354, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.810219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.828111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 769/1576] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:44.828111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.875435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.887634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 808/1577] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:44 2022] PUT /identity/v3/projects/34ceb3d97e6d4579b45231db6d0aa7ee/users/b498e100c357430cbe953fab1a7eb354/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:44.888721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.892813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377cd5-7db6-4a21-b146-415d1600a218 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.894440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.956835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.959929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.960067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde8d53-56c8-4608-bfcc-bfb1d904aaed admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.961047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.961047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.961047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.961047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.962523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.963135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.963418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.963691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.964340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.966336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.055894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 770/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/projects => generated 391 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.055894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.066921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 809/1579] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:44 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.067892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.128249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc6c6-7602-43d1-94e1-8d288963483b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.149682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329129ff-be30-4386-8b08-58da509895f2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.154452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.155057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.155394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.155854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.156698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.158329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.168535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 810/1580] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.169739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.180102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dfc28-93fd-4f56-bb1c-f3da054583fe admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.185085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.185700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.186025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.186303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.188179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.189478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.194609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.195280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.195565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.195845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] PATH_INFO: `/v3/projects/3aa32153716e49dbaf271ddf93379ff1/users/92bb6d1386904f8a812c477860c65f9c/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.211976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa32153716e49dbaf271ddf93379ff1, user_id=92bb6d1386904f8a812c477860c65f9c, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.215556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:37:45.215556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:37:45.215556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:37:45.215556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.320680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 811/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.321511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.331465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bab89-adc8-484d-9cc2-19553f3ba4f6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.333824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 771/1582] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:45 2022] PUT /identity/v3/projects/3aa32153716e49dbaf271ddf93379ff1/users/92bb6d1386904f8a812c477860c65f9c/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:45.334716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.345136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:45.393042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed45fb0-b152-406c-a847-d8f8291d88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.393616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45fb0-b152-406c-a847-d8f8291d88d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.393918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45fb0-b152-406c-a847-d8f8291d88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.394224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed45fb0-b152-406c-a847-d8f8291d88d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.394976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45fb0-b152-406c-a847-d8f8291d88d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.396899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed45fb0-b152-406c-a847-d8f8291d88d9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.400992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df314bb-ae70-49f1-aac0-b0eb919eb656 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.405798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.406858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.407146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.407426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.408061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.408216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:45.410018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.510820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 812/1583] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.512098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.512385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.512661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.541569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] MFA Rules not processed for user `b498e100c357430cbe953fab1a7eb354`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:45.542808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:45.546304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 772/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.546304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.557014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49229b28-eb18-4852-b8fc-887c72f154d8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.561873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.563253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.563573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.563879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.564624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.566606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.621807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 813/1585] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:45.621807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.636037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4a3e4-000e-4961-91fb-2230f50df65e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.640983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd433a-61eb-4b10-bbda-0b260316267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.641606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd433a-61eb-4b10-bbda-0b260316267e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.641917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd433a-61eb-4b10-bbda-0b260316267e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.642198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd433a-61eb-4b10-bbda-0b260316267e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.642831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd433a-61eb-4b10-bbda-0b260316267e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.645052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd433a-61eb-4b10-bbda-0b260316267e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.692806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 773/1586] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.694017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.705957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec9ddb-265a-4ebd-b9dd-443515f9519c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.710647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.711259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.711534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.711805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.712442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.714100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.725554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 774/1587] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.726463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.736728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eff01-886b-4bcd-a227-aeda786add5e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.741335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.741974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.742256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.742527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.743189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.744747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.751352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 814/1588] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:45.754059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.754059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.754059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.760557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 775/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.760557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.771522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2b858-9b27-4838-af68-66deff2813c8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.776977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:45.776977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:45.777177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5ae0-4eb3-4452-ae7a-02236d0b0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.777177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5ae0-4eb3-4452-ae7a-02236d0b0ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.777405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5ae0-4eb3-4452-ae7a-02236d0b0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.777681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5ae0-4eb3-4452-ae7a-02236d0b0ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.778394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e5ae0-4eb3-4452-ae7a-02236d0b0ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.780036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e5ae0-4eb3-4452-ae7a-02236d0b0ca4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.784384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 815/1590] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:45.785190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.794135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 776/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.795484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2ea3b-ad85-48b9-918c-a84393430733 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.800139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2683-ee06-4354-908a-2390f8530538 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.800139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2683-ee06-4354-908a-2390f8530538 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.800139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc2683-ee06-4354-908a-2390f8530538 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.800139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 777/1592] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 24 09:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:45.800139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2683-ee06-4354-908a-2390f8530538 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.800663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.800663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.800663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.800936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.801545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.803193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.814960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc2683-ee06-4354-908a-2390f8530538 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.815276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 816/1593] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.815882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.831662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.832292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.832578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.832858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.833085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f872df9-4647-4ed1-a94c-82d8eb85e59d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.833513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.835194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.838625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.839340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.839911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.841261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] PATH_INFO: `/v3/projects/6c94254a96fb45a8ad3d67e0ed641f3d/users/ad5b695402bd49c0b9d23c2b547ad6eb/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.846653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 778/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.851657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.857580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a213f-9017-4030-bb3e-818355172091 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.859334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c94254a96fb45a8ad3d67e0ed641f3d, user_id=ad5b695402bd49c0b9d23c2b547ad6eb, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.862484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.862841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.863104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.863390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.863670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.864315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.865923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.876958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 779/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.883252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.887435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d641-9af5-4bdf-99da-c6838f0d5631 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.892777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:45.893364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.893648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.893953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.894587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:45.896227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:45.906090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 780/1596] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:45.907049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.908835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:45.966826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519589d-1037-4834-8cd6-a9328a4b3b2b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:45.972838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 817/1597] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:45 2022] PUT /identity/v3/projects/6c94254a96fb45a8ad3d67e0ed641f3d/users/ad5b695402bd49c0b9d23c2b547ad6eb/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:45.974349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:45.996003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:46.026247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.026874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.027156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.027452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.048367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79b506-13e7-4279-832a-9b24c05772cf admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.053330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358bd0a-cdf7-42f0-8833-2a2edd970907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.053977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358bd0a-cdf7-42f0-8833-2a2edd970907 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.054267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358bd0a-cdf7-42f0-8833-2a2edd970907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.054566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358bd0a-cdf7-42f0-8833-2a2edd970907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.055219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358bd0a-cdf7-42f0-8833-2a2edd970907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.056992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358bd0a-cdf7-42f0-8833-2a2edd970907 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.067754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 818/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:46.069525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5c57-7f50-4b69-bc80-e636bb4a28e5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.069912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5c57-7f50-4b69-bc80-e636bb4a28e5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.070262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d5c57-7f50-4b69-bc80-e636bb4a28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.093397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.095469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.106356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 781/1599] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:46.107399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.117831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c06ae-d7db-4414-937b-98c876ed0651 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.119858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-737d5c57-7f50-4b69-bc80-e636bb4a28e5 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:46.121334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-737d5c57-7f50-4b69-bc80-e636bb4a28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:46.124009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.125006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.125515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.126121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.126850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.128529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.128793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:46.140417 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 782/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:46.142238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.154484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cb44f-3f75-4873-a9b4-3c879be5f44a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.160026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.160636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.160914 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.161183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.161822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.163441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.174345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 783/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:46.175177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.184979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93c4e-8bb2-4716-bf5b-5f5f0062450d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.190190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.190795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.191073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.191342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.191975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.193560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.206222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 784/1602] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:46.207565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.212163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 819/1603] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 24 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:46.213563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.213970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.214318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.221722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d683e3-bb26-4334-8d66-4c8c5fcb00e8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.227582 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.228406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.228757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.229091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] PATH_INFO: `/v3/projects/f3e1dc39056e45ae91bc881136f95393/users/3278d59df25c4fdda9092de62cc7dc80/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.252133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1dc39056e45ae91bc881136f95393, user_id=3278d59df25c4fdda9092de62cc7dc80, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.255167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.257106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] MFA Rules not processed for user `ad5b695402bd49c0b9d23c2b547ad6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:46.258928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:46.332185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 820/1604] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:46.333021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.343194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35ee87-78a3-49dc-92c8-111bab0116a7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.348463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.349129 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.349412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.349689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] PATH_INFO: `/v3/projects/25f717b7f46542d7a65e243063189762/users/8d20d4884adf47049081bc87e988d4e4/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.359939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 785/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:46 2022] PUT /identity/v3/projects/f3e1dc39056e45ae91bc881136f95393/users/3278d59df25c4fdda9092de62cc7dc80/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:46.371092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.371239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f717b7f46542d7a65e243063189762, user_id=8d20d4884adf47049081bc87e988d4e4, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.371239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.426135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db56eba-c981-481e-9a8d-656eb20c4542 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.438057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.438057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.438057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.438057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] PATH_INFO: `/v3/projects/72f810cccc984a7a9859f8fce50d2002/users/f4266683d5cd4716b33df6377ffa498b/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.447819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f810cccc984a7a9859f8fce50d2002, user_id=f4266683d5cd4716b33df6377ffa498b, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.450651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.511564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 821/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:46 2022] PUT /identity/v3/projects/25f717b7f46542d7a65e243063189762/users/8d20d4884adf47049081bc87e988d4e4/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:46.518038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.583983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 786/1607] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:46 2022] PUT /identity/v3/projects/72f810cccc984a7a9859f8fce50d2002/users/f4266683d5cd4716b33df6377ffa498b/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:46.584806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.585070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327ad8-516d-4794-8c9c-45e6a5543bca admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.590365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:46.596002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:46.651025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.651848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.652228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.652637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] PATH_INFO: `/v3/projects/5819536ee009471cb564a69f4a6bdb39/users/3309a24e48f243b2a7d9b84adb1dd815/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.659865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344c17-d2f4-4d71-8053-be730193b0e4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.666280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.667367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.667655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.667940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] PATH_INFO: `/v3/projects/e8a440e0b7d2444caf43b038402db65f/users/1b5b8c2d0ea44352b58b4887b5836bc6/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.669272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5819536ee009471cb564a69f4a6bdb39, user_id=3309a24e48f243b2a7d9b84adb1dd815, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.672320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.685367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a440e0b7d2444caf43b038402db65f, user_id=1b5b8c2d0ea44352b58b4887b5836bc6, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.688810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.786079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 822/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:46 2022] PUT /identity/v3/projects/5819536ee009471cb564a69f4a6bdb39/users/3309a24e48f243b2a7d9b84adb1dd815/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:46.787249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.801536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 787/1609] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:46 2022] PUT /identity/v3/projects/e8a440e0b7d2444caf43b038402db65f/users/1b5b8c2d0ea44352b58b4887b5836bc6/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:46.804520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.867557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ecab9-0692-45c7-8568-5fa712602343 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.871326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8444cd-0820-4caf-99ce-fef278f20662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.871930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8444cd-0820-4caf-99ce-fef278f20662 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.872234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8444cd-0820-4caf-99ce-fef278f20662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.872505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8444cd-0820-4caf-99ce-fef278f20662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.877619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095c7d0-a48b-40f9-b314-17ca9ac9cbaf admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.939143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8444cd-0820-4caf-99ce-fef278f20662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.940496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8444cd-0820-4caf-99ce-fef278f20662 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.950035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 788/1610] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:46.951120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16cb42-7464-41d5-bebc-7c1b1d2e7772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.951267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631956-cab9-461b-9e13-eec019759b5b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.951544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631956-cab9-461b-9e13-eec019759b5b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.951815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631956-cab9-461b-9e13-eec019759b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.952331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16cb42-7464-41d5-bebc-7c1b1d2e7772 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.952774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16cb42-7464-41d5-bebc-7c1b1d2e7772 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.953689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16cb42-7464-41d5-bebc-7c1b1d2e7772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.989826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-17631956-cab9-461b-9e13-eec019759b5b None None] MFA Rules not processed for user `3278d59df25c4fdda9092de62cc7dc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:46.991324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-17631956-cab9-461b-9e13-eec019759b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:46.993078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:47.027810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16cb42-7464-41d5-bebc-7c1b1d2e7772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.030230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16cb42-7464-41d5-bebc-7c1b1d2e7772 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.035047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:47.042253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 823/1611] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:47.043667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaaf45-ed9f-43b1-bdb1-fee9e585c5f2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.044016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaaf45-ed9f-43b1-bdb1-fee9e585c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.044225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaaf45-ed9f-43b1-bdb1-fee9e585c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.075293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b9eaaf45-ed9f-43b1-bdb1-fee9e585c5f2 None None] MFA Rules not processed for user `8d20d4884adf47049081bc87e988d4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:47.076135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 789/1612] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.076889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b9eaaf45-ed9f-43b1-bdb1-fee9e585c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.082661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fabf8-1e55-4221-abb3-416341ffa8a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.083335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fabf8-1e55-4221-abb3-416341ffa8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.083711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fabf8-1e55-4221-abb3-416341ffa8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.112514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-304fabf8-1e55-4221-abb3-416341ffa8a6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:47.114681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-304fabf8-1e55-4221-abb3-416341ffa8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.178330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 824/1613] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.178330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.178330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.178330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.206806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:47.208608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.212020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 790/1614] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.212020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f67d-3ddf-41d9-b1cd-fb6fd32866f6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.216969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f67d-3ddf-41d9-b1cd-fb6fd32866f6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.216969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8f67d-3ddf-41d9-b1cd-fb6fd32866f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.229026 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 825/1615] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.230247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.255299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943312b-3e16-4567-a52c-f6ef70cfe46d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.257118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8bc8f67d-3ddf-41d9-b1cd-fb6fd32866f6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:47.259882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8bc8f67d-3ddf-41d9-b1cd-fb6fd32866f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.267669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.269057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.271756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.272153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.273261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.274352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 791/1616] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.275801 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778c69-cce0-46f3-8d06-34b0c207eac0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.276191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778c69-cce0-46f3-8d06-34b0c207eac0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.276548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778c69-cce0-46f3-8d06-34b0c207eac0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.278496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 792/1617] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 24 09:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:47.279644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778c69-cce0-46f3-8d06-34b0c207eac0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.286939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.376394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778c69-cce0-46f3-8d06-34b0c207eac0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.382253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af1f30-e8c4-4b9e-8120-5f6fa4e6451d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.383571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1f30-e8c4-4b9e-8120-5f6fa4e6451d service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.383571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1f30-e8c4-4b9e-8120-5f6fa4e6451d service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.383571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af1f30-e8c4-4b9e-8120-5f6fa4e6451d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.397897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af1f30-e8c4-4b9e-8120-5f6fa4e6451d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.399173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af1f30-e8c4-4b9e-8120-5f6fa4e6451d service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.410120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 826/1618] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:47.411285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.414763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 793/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:47.424198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.424605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.425201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.447143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:47.448497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.473892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1e33-17f2-4f4f-b7ad-9f8cf85456e8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.477745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125d836-067e-4883-a688-93baa7bdbf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.478434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125d836-067e-4883-a688-93baa7bdbf58 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.478711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125d836-067e-4883-a688-93baa7bdbf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.478981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125d836-067e-4883-a688-93baa7bdbf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.524214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:47.528017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:47.536474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 794/1620] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.537641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.545124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125d836-067e-4883-a688-93baa7bdbf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.547182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125d836-067e-4883-a688-93baa7bdbf58 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.551503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c038d4-1b3b-4f87-bc63-b25f0214ce44 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.555078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.555691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.555978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.556627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.558693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 827/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:47.559928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e90f2-703a-415d-a17e-a2e306fc1b2a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.560314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e90f2-703a-415d-a17e-a2e306fc1b2a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.560980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e90f2-703a-415d-a17e-a2e306fc1b2a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.567422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 828/1622] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 24 09:37:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:47.568163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e90f2-703a-415d-a17e-a2e306fc1b2a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.579617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.581220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.588446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e90f2-703a-415d-a17e-a2e306fc1b2a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.592204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 795/1623] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:47.593233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.594220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.595135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.595499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.595899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.596817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.598953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.607722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61515f-7112-4168-b315-d2124020eb4c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.614746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907e68b-f728-49b1-8f9f-c9bec07e487d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.615467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907e68b-f728-49b1-8f9f-c9bec07e487d service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.615816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907e68b-f728-49b1-8f9f-c9bec07e487d service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.616158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907e68b-f728-49b1-8f9f-c9bec07e487d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.680523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907e68b-f728-49b1-8f9f-c9bec07e487d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.682139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907e68b-f728-49b1-8f9f-c9bec07e487d service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.695325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 796/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:47.696953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.697478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.698018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.727778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:47.732678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.742659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 797/1625] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.763209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.769257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 829/1626] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:37:47 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:37:47.770205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.799300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cb3f6-c985-4635-ad6e-bf52b5cb9b2b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.803171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.803814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.804096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.804376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.805234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.809391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.837587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 830/1627] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:47.845457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.855541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca78ecf-9567-4097-9e03-b995e43b5c36 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.862172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c867394-c71a-4b52-99e0-745beca77482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.862930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c867394-c71a-4b52-99e0-745beca77482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.863268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c867394-c71a-4b52-99e0-745beca77482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.863555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c867394-c71a-4b52-99e0-745beca77482 admin admin] PATH_INFO: `/v3/projects/ff75ed935d824ca686739d9cac5bc31e/users/47bb173af68146109991a3c14eec556c/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.884194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c867394-c71a-4b52-99e0-745beca77482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff75ed935d824ca686739d9cac5bc31e, user_id=47bb173af68146109991a3c14eec556c, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.888234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c867394-c71a-4b52-99e0-745beca77482 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.917312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc52f3-51ce-4ed6-b7ae-2004b456f83e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.921814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.922534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.922864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.923148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.935656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.937168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.982197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 798/1628] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:48.016955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 831/1629] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:47 2022] PUT /identity/v3/projects/ff75ed935d824ca686739d9cac5bc31e/users/47bb173af68146109991a3c14eec556c/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:48.017455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:48.028897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec383bb-6870-428f-b0b5-e479e8af825f service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:48.114426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcfac-0665-4e40-8823-05b18c3d71a2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:48.115050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcfac-0665-4e40-8823-05b18c3d71a2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:48.115661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcfac-0665-4e40-8823-05b18c3d71a2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:48.117372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 832/1630] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 24 09:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:37:48.136415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:48.137243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:48.137582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:48.192815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:48.195350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:48.234581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:48.235478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:48.242627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:48.247948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:48.247948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:48.247948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:48.271919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 799/1631] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:37:48.278781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:48.300211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c722d6-ba20-4fdc-97b0-41cdb8807a03 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:48.314436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffac10-2e0c-4db5-ae0e-ad0d25486a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:48.315267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffac10-2e0c-4db5-ae0e-ad0d25486a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:48.315565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffac10-2e0c-4db5-ae0e-ad0d25486a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:48.315878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffac10-2e0c-4db5-ae0e-ad0d25486a79 admin admin] PATH_INFO: `/v3/projects/ff75ed935d824ca686739d9cac5bc31e/users/47bb173af68146109991a3c14eec556c/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:48.318277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffac10-2e0c-4db5-ae0e-ad0d25486a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff75ed935d824ca686739d9cac5bc31e, user_id=47bb173af68146109991a3c14eec556c, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:48.331614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffac10-2e0c-4db5-ae0e-ad0d25486a79 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:48.391515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 800/1632] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:37:48 2022] PUT /identity/v3/projects/ff75ed935d824ca686739d9cac5bc31e/users/47bb173af68146109991a3c14eec556c/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:48.402585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:48.402873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:48.403365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:48.417356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 833/1633] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:37:48.425186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:48.453549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] MFA Rules not processed for user `47bb173af68146109991a3c14eec556c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:48.456018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:48.496096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:48.570555 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 801/1634] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:37:48.603976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f70df-6b9a-432b-9f6c-c20553ad244f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:48.702626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:48.743718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:48.744359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:48.744649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:48.744924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:48.870584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:48.872089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:48.886477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 834/1635] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:49.486998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:49.511965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37bd7d-2386-41d6-88dc-909b3b80cb9c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:49.525116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:49.526172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:49.526515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:49.526893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:49.538878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:49.540851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:49.553527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 802/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:50.301878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:50.328914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68790991-48c8-4d2e-8646-f01d72ea6448 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:50.347132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bedbb-0196-48e4-8c89-72d7f3a777cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:50.347798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bedbb-0196-48e4-8c89-72d7f3a777cb service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:50.348080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bedbb-0196-48e4-8c89-72d7f3a777cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:50.348591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bedbb-0196-48e4-8c89-72d7f3a777cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:50.527491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bedbb-0196-48e4-8c89-72d7f3a777cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:50.529272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bedbb-0196-48e4-8c89-72d7f3a777cb service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:50.559097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 835/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:55.476710 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:55.617518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca18149-9679-4d51-b4db-59ccc1d3dcb2 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:55.659830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:55.662189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:55.662189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:55.662189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] PATH_INFO: `/v3/users/8d20d4884adf47049081bc87e988d4e4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:55.670661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d20d4884adf47049081bc87e988d4e4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:55.674936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: WARNING py.warnings [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:37:55.674936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: warnings.warn(msg) Aug 24 09:37:55.674936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: Aug 24 09:37:55.682347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:56.110077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d20d4884adf47049081bc87e988d4e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:56.114458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d20d4884adf47049081bc87e988d4e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:56.119708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d20d4884adf47049081bc87e988d4e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:56.166813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d20d4884adf47049081bc87e988d4e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:56.255755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d20d4884adf47049081bc87e988d4e4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:56.265263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:56.398914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:56.399408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:56.399728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:56.402918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 803/1638] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:37:55 2022] DELETE /identity/v3/users/8d20d4884adf47049081bc87e988d4e4 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:56.464436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:56.466426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:56.703142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 836/1639] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:37:56.807112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:56.809804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:57.024933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8461511-7c2a-4d27-b140-88e999868b09 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:57.037559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85517ad4-20d7-42cf-a104-f79d76b0eceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:57.038640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517ad4-20d7-42cf-a104-f79d76b0eceb service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:57.039886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517ad4-20d7-42cf-a104-f79d76b0eceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:57.040184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85517ad4-20d7-42cf-a104-f79d76b0eceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:57.064723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85517ad4-20d7-42cf-a104-f79d76b0eceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:57.066967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85517ad4-20d7-42cf-a104-f79d76b0eceb service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:57.085367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 804/1640] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:58.062009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:58.063597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:58.096812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbc248-6a9a-4cfb-8656-fe9b81ddb5bd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:58.119820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:58.121512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:58.136772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:58.137282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] PATH_INFO: `/v3/users/b498e100c357430cbe953fab1a7eb354` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:58.138983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b498e100c357430cbe953fab1a7eb354)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:58.143999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:58.181287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:58.468466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b498e100c357430cbe953fab1a7eb354'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:58.583762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b498e100c357430cbe953fab1a7eb354'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:58.584591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b498e100c357430cbe953fab1a7eb354'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:58.612075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b498e100c357430cbe953fab1a7eb354'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:58.614831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b498e100c357430cbe953fab1a7eb354'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:37:58.677561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:58.678174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:58.678537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:58.682253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 837/1641] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:37:58 2022] DELETE /identity/v3/users/b498e100c357430cbe953fab1a7eb354 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:37:58.740997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:58.747116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:58.911018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 805/1642] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:59.013006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:59.015159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:59.105181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88cb72-d6ac-4bf2-8441-6b524cf55d76 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:59.108168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:59.109276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:59.109823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:59.110346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:59.121821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:59.124688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:59.136487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 838/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:00.024794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:00.027608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:00.063796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d58da-2ad3-45e4-be1a-b4c2120977ef None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:00.082758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:00.083440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:00.089277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:00.089277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] PATH_INFO: `/v3/projects/34ceb3d97e6d4579b45231db6d0aa7ee` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:00.089277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ceb3d97e6d4579b45231db6d0aa7ee)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:00.091573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:00.334714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ceb3d97e6d4579b45231db6d0aa7ee', 'request_id': 'req-773e5679-3c69-436f-8086-e7972fe4f520'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.354892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ceb3d97e6d4579b45231db6d0aa7ee', 'request_id': 'req-773e5679-3c69-436f-8086-e7972fe4f520'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.405807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:00.407546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:00.433414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0889-a762-49dd-bc0c-20c43b087269 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:00.439032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ceb3d97e6d4579b45231db6d0aa7ee', 'request_id': 'req-773e5679-3c69-436f-8086-e7972fe4f520'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.458783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] The token cache is being invalidate because project 34ceb3d97e6d4579b45231db6d0aa7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:00.460077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.463429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-773e5679-3c69-436f-8086-e7972fe4f520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.467568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 806/1644] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:00 2022] DELETE /identity/v3/projects/34ceb3d97e6d4579b45231db6d0aa7ee => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:00.472915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4a41a-b261-4d51-9943-d66bda8f3c2f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:00.477831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4a41a-b261-4d51-9943-d66bda8f3c2f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:00.477831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4a41a-b261-4d51-9943-d66bda8f3c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:00.529562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e5c4a41a-b261-4d51-9943-d66bda8f3c2f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:00.531345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e5c4a41a-b261-4d51-9943-d66bda8f3c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:00.567503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:00.620848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:00.621782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:00.625678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:00.626339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] PATH_INFO: `/v3/projects/25f717b7f46542d7a65e243063189762` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:00.629289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f717b7f46542d7a65e243063189762)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:00.630642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: WARNING py.warnings [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:38:00.630642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: warnings.warn(msg) Aug 24 09:38:00.630642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: Aug 24 09:38:00.634268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:00.662560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 807/1645] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:00.674431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:00.682642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:00.682994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:00.726621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:00.731593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:00.760658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 808/1646] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:00.765249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:00.790049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f2e64-edb1-43e8-987a-0f79eece27f7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:00.817448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:00.818245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:00.818534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:00.818812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:00.819572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:00.823379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:00.827705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:00.829718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:00.860492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 809/1647] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:38:00.864762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f717b7f46542d7a65e243063189762', 'request_id': 'req-1358039a-df80-452a-973f-dc004a833d7a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.864928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:00.885245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f717b7f46542d7a65e243063189762', 'request_id': 'req-1358039a-df80-452a-973f-dc004a833d7a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:00.887643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146447d-8bdf-44f5-a549-ea753d5054c0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:00.967673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f717b7f46542d7a65e243063189762', 'request_id': 'req-1358039a-df80-452a-973f-dc004a833d7a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:01.025215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] The token cache is being invalidate because project 25f717b7f46542d7a65e243063189762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:01.028324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:01.031586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1358039a-df80-452a-973f-dc004a833d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:01.040045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 839/1648] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:00 2022] DELETE /identity/v3/projects/25f717b7f46542d7a65e243063189762 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:01.046002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a1fcc-846d-4173-8449-29d501a639d5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.046303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a1fcc-846d-4173-8449-29d501a639d5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.046766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a1fcc-846d-4173-8449-29d501a639d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.056317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:01.065704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.066315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.066814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.067736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:01.070027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:01.102168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0b5a1fcc-846d-4173-8449-29d501a639d5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:01.104255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0b5a1fcc-846d-4173-8449-29d501a639d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.124814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 840/1649] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:01.127847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba341e8-0ce3-4752-879b-8e7b71d538c0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.128345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba341e8-0ce3-4752-879b-8e7b71d538c0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.128786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba341e8-0ce3-4752-879b-8e7b71d538c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.164063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fba341e8-0ce3-4752-879b-8e7b71d538c0 None None] MFA Rules not processed for user `92bb6d1386904f8a812c477860c65f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:01.165653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fba341e8-0ce3-4752-879b-8e7b71d538c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.269463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 841/1650] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:01.271238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 810/1651] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:00 2022] POST /identity/v3/projects => generated 357 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:01.276628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:01.282014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.285045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f277a-b95c-457d-861b-3e3a10521286 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.285511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f277a-b95c-457d-861b-3e3a10521286 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.285804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f277a-b95c-457d-861b-3e3a10521286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.328664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4d4f277a-b95c-457d-861b-3e3a10521286 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:01.334949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d4f277a-b95c-457d-861b-3e3a10521286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.459330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1edfc-3787-446a-99b8-8a0a8833f30f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:01.473821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:01.474823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.475623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.476606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.478137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:01.488968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:01.510481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 842/1652] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:01.511820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.512127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.512389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.559667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] MFA Rules not processed for user `92bb6d1386904f8a812c477860c65f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:01.561648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.627911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 811/1653] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/users => generated 279 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:01.633109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:01.663314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a47b6-5852-4665-9704-2884d30352d9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:01.703497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:01.704162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.704461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.704722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.705399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:01.705711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:01.711624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:01.760959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 812/1654] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:38:01.765193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:01.792064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 843/1655] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:01.792064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:01.797013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b62a-ec5a-458b-897a-0cbec4e77d0b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:01.830961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:01.831597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.832206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.832206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.832810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:01.834479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:01.842154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a207c-8bac-4294-8f50-cea9453babfa None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:01.859286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:01.859921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.860283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.860462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.861104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:01.863117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:01.872698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 813/1656] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:01.884174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:01.892683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.080702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 844/1657] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/projects => generated 365 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:02.085776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:02.146700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6999dfd-b6bd-4b90-b88d-97d7aa345760 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.281641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b47e2-b201-44f5-98b0-acedcc1a31d3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.295602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.296450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.296741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.297021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.299522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.303785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.310612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.312290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.312838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.313283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.331855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 845/1658] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:02.333786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:02.354506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd49701-7e10-4550-8d73-6d3e71d8a44d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.369588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f90a9f-6331-40a6-9943-b1c0e7c51d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.370547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f90a9f-6331-40a6-9943-b1c0e7c51d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.370773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f90a9f-6331-40a6-9943-b1c0e7c51d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.371047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f90a9f-6331-40a6-9943-b1c0e7c51d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.371690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f90a9f-6331-40a6-9943-b1c0e7c51d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.374506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f90a9f-6331-40a6-9943-b1c0e7c51d5b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.416298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.417537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.429380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 814/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:02.438524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:02.468091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7dfc5-fbb2-4fae-9515-bf20d353d501 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.475562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.478978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.478978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.478978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] PATH_INFO: `/v3/projects/89f4338b66754b41be26b8b4be2a5e59/users/eded5f7548af4f0f8f80bf26bde7b2c5/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.494832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f4338b66754b41be26b8b4be2a5e59, user_id=eded5f7548af4f0f8f80bf26bde7b2c5, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.497569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.511781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 846/1660] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:02 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:02.513798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.519261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.519261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.532335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:02.574233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 815/1661] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:02 2022] PUT /identity/v3/projects/89f4338b66754b41be26b8b4be2a5e59/users/eded5f7548af4f0f8f80bf26bde7b2c5/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:02.575305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:02.591285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] MFA Rules not processed for user `3309a24e48f243b2a7d9b84adb1dd815`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:02.604518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.758227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fada49-ab7f-4f3f-8850-9dc25a246cbd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.769425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767b632-9ad2-4a0d-b6d2-7d399d588eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.770338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767b632-9ad2-4a0d-b6d2-7d399d588eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.770495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767b632-9ad2-4a0d-b6d2-7d399d588eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.770754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767b632-9ad2-4a0d-b6d2-7d399d588eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.772901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:02.775121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767b632-9ad2-4a0d-b6d2-7d399d588eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.776792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767b632-9ad2-4a0d-b6d2-7d399d588eb5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.792340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 816/1662] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:02.792340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.792340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.792340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.826337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 847/1663] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:02.828646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:02.855417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7112-4037-449d-bc26-0a54755ef038 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.864423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] MFA Rules not processed for user `eded5f7548af4f0f8f80bf26bde7b2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:02.868354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.874509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27cb80-1236-41ac-bd45-7be9b963a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.876096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27cb80-1236-41ac-bd45-7be9b963a3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.876548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27cb80-1236-41ac-bd45-7be9b963a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.877978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27cb80-1236-41ac-bd45-7be9b963a3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.879345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27cb80-1236-41ac-bd45-7be9b963a3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.887681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27cb80-1236-41ac-bd45-7be9b963a3d3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.919295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 848/1664] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:02.921301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.922780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.923356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.976657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] MFA Rules not processed for user `3309a24e48f243b2a7d9b84adb1dd815`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:02.979398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.999957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 849/1665] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:03.001492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:03.031009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8588af-c807-4bf4-b0ee-f4053b294188 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:03.035871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 817/1666] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:03.036922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:03.042700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:03.043433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:03.044601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.047045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.047592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] PATH_INFO: `/v3/projects/42445041ea6743b4a5565374b22478cd/users/5e60d9c410664053a1e4bf5fb23603a5/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.080201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42445041ea6743b4a5565374b22478cd, user_id=5e60d9c410664053a1e4bf5fb23603a5, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:03.083554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:03.182473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 850/1667] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:03 2022] PUT /identity/v3/projects/42445041ea6743b4a5565374b22478cd/users/5e60d9c410664053a1e4bf5fb23603a5/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:03.183984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:03.241427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fd31e-f09a-4eda-840f-13ac6b825367 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:03.350044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bd8c4-5511-4c84-adc4-e341fabc9d43 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:03.371418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b2359-aac2-4c66-85c8-31eb1b1f1ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:03.372263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b2359-aac2-4c66-85c8-31eb1b1f1ecc admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.372650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b2359-aac2-4c66-85c8-31eb1b1f1ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.375871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b2359-aac2-4c66-85c8-31eb1b1f1ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.377745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b2359-aac2-4c66-85c8-31eb1b1f1ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:03.385172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b2359-aac2-4c66-85c8-31eb1b1f1ecc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:03.409674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20aecd-1c4a-408e-b60f-0eebf6334d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:03.410592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20aecd-1c4a-408e-b60f-0eebf6334d88 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.411020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20aecd-1c4a-408e-b60f-0eebf6334d88 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.411452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20aecd-1c4a-408e-b60f-0eebf6334d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.506929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 851/1668] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:03 2022] POST /identity/v3/projects => generated 355 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:03.508708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.509228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.509725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.556713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20aecd-1c4a-408e-b60f-0eebf6334d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:03.558517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20aecd-1c4a-408e-b60f-0eebf6334d88 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:03.569763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] MFA Rules not processed for user `5e60d9c410664053a1e4bf5fb23603a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:03.571999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:03.583308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 818/1669] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:03.583308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf1fc-38e9-4e0e-a9ab-885203cf3967 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.583308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf1fc-38e9-4e0e-a9ab-885203cf3967 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.583308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bf1fc-38e9-4e0e-a9ab-885203cf3967 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.583860 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 819/1670] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 24 09:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:03.584644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf1fc-38e9-4e0e-a9ab-885203cf3967 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:03.660574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 852/1671] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:03.661998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:03.663603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:03.738445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bf1fc-38e9-4e0e-a9ab-885203cf3967 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:03.743819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433ab10-87e3-4c60-8b57-da43675f5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:03.744453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433ab10-87e3-4c60-8b57-da43675f5914 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.744733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433ab10-87e3-4c60-8b57-da43675f5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.745008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433ab10-87e3-4c60-8b57-da43675f5914 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.745702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433ab10-87e3-4c60-8b57-da43675f5914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:03.755286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433ab10-87e3-4c60-8b57-da43675f5914 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:03.841921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde4806-f377-4e74-a9de-4e77fb807523 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:03.858557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:03.861978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.862252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.862522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] PATH_INFO: `/v3/users/ad5b695402bd49c0b9d23c2b547ad6eb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.893831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5b695402bd49c0b9d23c2b547ad6eb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:03.900476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:03.909361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 820/1672] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:03 2022] POST /identity/v3/users => generated 284 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:03.909783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.910203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.910561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.013967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:04.015853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.060711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:04.146457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 821/1673] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:04.147337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:04.176755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79926de8-f5cc-4943-aa99-b674dcaaa744 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:04.194959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:04.195886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.196311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.196739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.197547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:04.200780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:04.206913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5b695402bd49c0b9d23c2b547ad6eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:04.305626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5b695402bd49c0b9d23c2b547ad6eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:04.306430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5b695402bd49c0b9d23c2b547ad6eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:04.330890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5b695402bd49c0b9d23c2b547ad6eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:04.332355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5b695402bd49c0b9d23c2b547ad6eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:04.352926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 822/1674] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:04 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:04.359679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:04.372113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.390255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 853/1675] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:03 2022] DELETE /identity/v3/users/ad5b695402bd49c0b9d23c2b547ad6eb => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:04.391380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:04.396831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.564155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22885cd1-365e-45de-bac9-bd4ee233dd73 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:04.577968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:04.577968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.577968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.586995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.591341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67656ac-9180-4f16-8e50-8946e17d7562 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:04.592454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.609910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:04.611957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52353e-a7e1-41a6-b553-765c5c9e7318 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:04.625336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 854/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:04.630176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2cb68-4480-4d4f-9996-05b483782e47 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.634473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2cb68-4480-4d4f-9996-05b483782e47 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.634473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2cb68-4480-4d4f-9996-05b483782e47 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.636426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 855/1677] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 24 09:38:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:04.638547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2cb68-4480-4d4f-9996-05b483782e47 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:04.648374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-51b2cb68-4480-4d4f-9996-05b483782e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.725323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a1fe7-3592-45e5-8eec-7a0347ce7655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:04.725660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a1fe7-3592-45e5-8eec-7a0347ce7655 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.725972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a1fe7-3592-45e5-8eec-7a0347ce7655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.726297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a1fe7-3592-45e5-8eec-7a0347ce7655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.727019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a1fe7-3592-45e5-8eec-7a0347ce7655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:04.730844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a1fe7-3592-45e5-8eec-7a0347ce7655 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:04.753919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 823/1678] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:04.756298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01c20-7059-4ce9-8ea7-2e1fd50ed0ea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.758171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01c20-7059-4ce9-8ea7-2e1fd50ed0ea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.759253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01c20-7059-4ce9-8ea7-2e1fd50ed0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.795706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5ff01c20-7059-4ce9-8ea7-2e1fd50ed0ea None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:04.797538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ff01c20-7059-4ce9-8ea7-2e1fd50ed0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.813295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 824/1679] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:04.815089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.815456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.815903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.822241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2cb68-4480-4d4f-9996-05b483782e47 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:04.830479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e892d-9d8f-4acb-ae9d-29382aabbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:04.830479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e892d-9d8f-4acb-ae9d-29382aabbd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.831989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e892d-9d8f-4acb-ae9d-29382aabbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.831989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e892d-9d8f-4acb-ae9d-29382aabbd95 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.832150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e892d-9d8f-4acb-ae9d-29382aabbd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:04.835214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e892d-9d8f-4acb-ae9d-29382aabbd95 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:04.874825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] MFA Rules not processed for user `f4266683d5cd4716b33df6377ffa498b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:04.877204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.957896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 856/1680] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:04 2022] POST /identity/v3/users => generated 289 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:04.959977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.963467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.964100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.015450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:05.016894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:05.021199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 825/1681] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:05.039003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.052688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 857/1682] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:05.053680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.055629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:05.067795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa30def-3503-4e5b-98d1-d4fa3adaaffe None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.073716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.074435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36def1-3bbf-4c8e-aaf6-d66746aceebb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.078171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.080655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:05.081825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.082414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.097193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.098216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.098788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.099078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] PATH_INFO: `/v3/projects/451c25e7b7804b549649b7915fe66087/users/517434cd4f494800ad19a9f589c33eb4/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.118463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.124323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.169139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c25e7b7804b549649b7915fe66087, user_id=517434cd4f494800ad19a9f589c33eb4, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.175077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 858/1683] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:05.177630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.177999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.200756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f1622-1a92-4af0-b2d4-0d4427380998 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.214924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.215897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.216512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.217591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.218575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.220542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.234948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 859/1684] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:05.236634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.252839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3eed9-dcf0-4bd1-b220-f7fa0ed2ee7e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.271709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 826/1685] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:05 2022] PUT /identity/v3/projects/451c25e7b7804b549649b7915fe66087/users/517434cd4f494800ad19a9f589c33eb4/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:05.273177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.293676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.294564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.294856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.295653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.314497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.317260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.356788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 860/1686] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:05.361555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.396948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99afcc5-d22f-45fd-8f48-1e731366103c service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.457236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:05.496832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27579f29-a236-4344-9a62-4d41bbd42d37 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.520451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.522693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.522789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.523044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] PATH_INFO: `/v3/projects/f9127b3ec6f947ac91e65f0ff7d451cc/users/a81b02901be04dda84558d1fa7d21ce9/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.591047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9127b3ec6f947ac91e65f0ff7d451cc, user_id=a81b02901be04dda84558d1fa7d21ce9, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.605593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.628743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.629743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.629743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.633148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.639457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.646941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.677738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 861/1687] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:05.678840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.692137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:05.729449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 827/1688] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:05 2022] PUT /identity/v3/projects/f9127b3ec6f947ac91e65f0ff7d451cc/users/a81b02901be04dda84558d1fa7d21ce9/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:05.730558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:05.878371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:06.018049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:06.032587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38c6a-9828-404d-8057-294d41b2c0a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:06.051646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:06.052619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec1b2f-2730-4d5b-b6c0-1376adcc0be5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:06.060852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.061833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.063521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] PATH_INFO: `/v3/projects/451c25e7b7804b549649b7915fe66087/users/517434cd4f494800ad19a9f589c33eb4/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.071993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c25e7b7804b549649b7915fe66087, user_id=517434cd4f494800ad19a9f589c33eb4, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:06.082421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:06.128468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 828/1689] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:05 2022] PUT /identity/v3/projects/451c25e7b7804b549649b7915fe66087/users/517434cd4f494800ad19a9f589c33eb4/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:06.128468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:06.244678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:06.245381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.245689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.251320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.347207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec606-df13-4a9f-9ec1-f46399cd92f9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:06.367177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c337812-9e4a-4c0c-8ea9-538721cc2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:06.369351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c337812-9e4a-4c0c-8ea9-538721cc2a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.370161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c337812-9e4a-4c0c-8ea9-538721cc2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.371629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c337812-9e4a-4c0c-8ea9-538721cc2a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.372457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c337812-9e4a-4c0c-8ea9-538721cc2a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:06.381482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c337812-9e4a-4c0c-8ea9-538721cc2a52 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:06.397955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 829/1690] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:06.400294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b076b-e640-4dc1-9834-6f9385bf5bf3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.400791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b076b-e640-4dc1-9834-6f9385bf5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.401272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b076b-e640-4dc1-9834-6f9385bf5bf3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.407517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 830/1691] 10.222.0.60 () {54 vars in 961 bytes} [Wed Aug 24 09:38:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:06.409530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98de9-2288-4ee2-bdd0-e6d9b5bb2cf0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.410644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98de9-2288-4ee2-bdd0-e6d9b5bb2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.411126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98de9-2288-4ee2-bdd0-e6d9b5bb2cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.445378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:06.445378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:06.463495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 862/1692] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:06.466679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:06.492885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45801ea-f013-43ae-9820-db15f55358ce service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:06.493927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-19a98de9-2288-4ee2-bdd0-e6d9b5bb2cf0 None None] MFA Rules not processed for user `517434cd4f494800ad19a9f589c33eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:06.495259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-19a98de9-2288-4ee2-bdd0-e6d9b5bb2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:06.526383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036bc53-0ba7-4d29-a199-2dde4de7f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:06.542193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036bc53-0ba7-4d29-a199-2dde4de7f9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.544578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036bc53-0ba7-4d29-a199-2dde4de7f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.545019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036bc53-0ba7-4d29-a199-2dde4de7f9bd admin admin] PATH_INFO: `/v3/projects/f9127b3ec6f947ac91e65f0ff7d451cc/users/a81b02901be04dda84558d1fa7d21ce9/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.558214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036bc53-0ba7-4d29-a199-2dde4de7f9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9127b3ec6f947ac91e65f0ff7d451cc, user_id=a81b02901be04dda84558d1fa7d21ce9, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:06.568653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036bc53-0ba7-4d29-a199-2dde4de7f9bd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:06.609580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 863/1693] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:06 2022] PUT /identity/v3/projects/f9127b3ec6f947ac91e65f0ff7d451cc/users/a81b02901be04dda84558d1fa7d21ce9/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:06.612506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.612805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.616291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.751906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] MFA Rules not processed for user `1b5b8c2d0ea44352b58b4887b5836bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:06.755134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:06.774885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 831/1694] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:06.776573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c040d-13e5-470c-8b74-097ed10104fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.777185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c040d-13e5-470c-8b74-097ed10104fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.777611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c040d-13e5-470c-8b74-097ed10104fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:06.827194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e61c040d-13e5-470c-8b74-097ed10104fe None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:06.831800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e61c040d-13e5-470c-8b74-097ed10104fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:06.921042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:06.969703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 832/1695] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Aug 24 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:06.971409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:06.971889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:06.972306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.002943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 864/1696] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:07.002943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.011247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.048819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f602ff6-0121-4352-9179-4f6623ad786f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.050443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] MFA Rules not processed for user `a81b02901be04dda84558d1fa7d21ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:07.051491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.057968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.059760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.060844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.061301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.064036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.085249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:07.088002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:07.104785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 865/1697] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:07.106234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.110235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.170997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 833/1698] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:07.172654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.206704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0371a0-d052-4d46-ab58-20bc5a40b5ba None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.228631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.230729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.231609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.232099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.251538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:07.253452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:07.259970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd773040-e384-48ed-87a6-3a20aa57563e service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.272860 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 834/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:07.274439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.276107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.279693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f348b3-f17b-440d-90e1-7c6d3263d626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.280420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f348b3-f17b-440d-90e1-7c6d3263d626 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.280773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f348b3-f17b-440d-90e1-7c6d3263d626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.282848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f348b3-f17b-440d-90e1-7c6d3263d626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.398013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f348b3-f17b-440d-90e1-7c6d3263d626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:07.399653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f348b3-f17b-440d-90e1-7c6d3263d626 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:07.432935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 866/1700] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:07.434372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.434661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.434942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.479619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] MFA Rules not processed for user `3309a24e48f243b2a7d9b84adb1dd815`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:07.480593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.497805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd831c65-ba9a-46a2-ba9b-5ddcf18a6c18 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.510697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.511565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.511974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.512319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.527465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:07.538080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:07.569116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 835/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:07.570610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.575846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.588189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 867/1702] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:07.589095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.594555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.628128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896da61-94d6-4e0a-ac9c-da9a83a4da1a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.639299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.640623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.641458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.641972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.703965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:07.716099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:07.743220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 868/1703] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:07.851055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e0c0f-2396-44bd-af3b-68cfa563f171 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.860858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.861538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.861883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.862155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] PATH_INFO: `/v3/projects/6c94254a96fb45a8ad3d67e0ed641f3d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.870303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c94254a96fb45a8ad3d67e0ed641f3d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:07.870303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:07.944334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.971166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f8e30-27bc-4646-b5d5-921e05fd1f18 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:07.977049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:07.984636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.984636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.984636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.984636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:08.015494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:08.054366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c94254a96fb45a8ad3d67e0ed641f3d', 'request_id': 'req-1dda4616-d6ef-479d-aad5-c7ed926746cd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:08.062149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c94254a96fb45a8ad3d67e0ed641f3d', 'request_id': 'req-1dda4616-d6ef-479d-aad5-c7ed926746cd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:08.159899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c94254a96fb45a8ad3d67e0ed641f3d', 'request_id': 'req-1dda4616-d6ef-479d-aad5-c7ed926746cd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:08.182105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] The token cache is being invalidate because project 6c94254a96fb45a8ad3d67e0ed641f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:08.184180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:08.184731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:08.186550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-1dda4616-d6ef-479d-aad5-c7ed926746cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:08.188265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:08.198852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 836/1704] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:07 2022] DELETE /identity/v3/projects/6c94254a96fb45a8ad3d67e0ed641f3d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:08.207012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:08.208549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:08.208936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:08.210531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 869/1705] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:08.211510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:08.230434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cae89-afc5-4b87-8cec-734fc7587bf7 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:08.261663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:08.263328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:08.305003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:08.344894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:08.345737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:08.346074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:08.346350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:08.348505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:08.443566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:08.447357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87736-9339-40de-9a33-15aefa800942 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:08.461754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 870/1706] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:08.511239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 837/1707] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:08.513440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:08.516896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:08.516896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:08.543756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:08.546053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:08.564390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:08.583737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 871/1708] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:08.585132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69035111-18d3-4da1-9f2f-013a84187609 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:08.593105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:08.594719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:08.595008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:08.595357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:08.596087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:08.596441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:08.599067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:08.627467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:08.648373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 838/1709] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:38:08.653134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a73a6-14f2-410d-9be8-b0ce85e85d72 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:08.674736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:08.675773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:08.676209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:08.676782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:08.678067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:08.699038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:08.867828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 872/1710] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:08 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:08.876697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:08.898733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541d26-24c3-47dc-bf09-2ec5e3636ae1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:09.127516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:09.128262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:09.128539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:09.128811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:09.130381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:09.143017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:09.628291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 839/1711] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:08 2022] POST /identity/v3/users => generated 287 bytes in 753 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:09.632269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:09.645932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0131ca-4ad9-402a-a840-c73a7290cd61 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:09.663123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:09.663761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:09.664479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:09.664768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:09.665438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:09.667273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:09.727169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 873/1712] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:09.727576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:09.745208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6fb2-9817-481e-ae61-4fde07d4a69d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:09.753015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c13403-1f40-4441-8591-830d0fd3ccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:09.753962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c13403-1f40-4441-8591-830d0fd3ccae admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:09.754435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c13403-1f40-4441-8591-830d0fd3ccae admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:09.754805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c13403-1f40-4441-8591-830d0fd3ccae admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:09.755803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c13403-1f40-4441-8591-830d0fd3ccae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:09.758952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c13403-1f40-4441-8591-830d0fd3ccae admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:09.779553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 840/1713] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:09.783548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:09.797451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16163e7-3df0-49c6-985d-ed371c6c882e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:09.810839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:09.811672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:09.812172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:09.812531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] PATH_INFO: `/v3/projects/867b1ad9d2354a58b942c65a3b5143ce/users/2140f84de3824f7892a9ffd61d12ce02/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:09.841841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867b1ad9d2354a58b942c65a3b5143ce, user_id=2140f84de3824f7892a9ffd61d12ce02, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:09.844983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:10.014208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 874/1714] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:09 2022] PUT /identity/v3/projects/867b1ad9d2354a58b942c65a3b5143ce/users/2140f84de3824f7892a9ffd61d12ce02/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:10.020771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:10.021565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:10.022325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:10.102020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] MFA Rules not processed for user `2140f84de3824f7892a9ffd61d12ce02`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:10.103925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:10.286161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 841/1715] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:10.299675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:10.301791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:10.369098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:10.463425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fce3ac-154b-4651-a3dd-70a1d5623c88 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:10.477279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330876a-fe11-4e58-88e4-e175462e034a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:10.478669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330876a-fe11-4e58-88e4-e175462e034a service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:10.479918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330876a-fe11-4e58-88e4-e175462e034a service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:10.479918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330876a-fe11-4e58-88e4-e175462e034a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:10.495042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330876a-fe11-4e58-88e4-e175462e034a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:10.507769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330876a-fe11-4e58-88e4-e175462e034a service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:10.513122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 875/1716] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:10.678837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:11.155518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:11.372244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:11.415148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:11.552953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d73c-bc9e-4d5c-a2dc-b9ec6de9c6d1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:11.566539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:11.567271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:11.567557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:11.574098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] PATH_INFO: `/v3/users/2140f84de3824f7892a9ffd61d12ce02` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:11.574098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2140f84de3824f7892a9ffd61d12ce02)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:11.576782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:11.963049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2140f84de3824f7892a9ffd61d12ce02'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:11.967876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2140f84de3824f7892a9ffd61d12ce02'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:11.968619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2140f84de3824f7892a9ffd61d12ce02'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:11.979846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2140f84de3824f7892a9ffd61d12ce02'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:12.030132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f295504f-d614-4d68-80a9-d5d259bcc903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2140f84de3824f7892a9ffd61d12ce02'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:12.185344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 842/1717] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:11 2022] DELETE /identity/v3/users/2140f84de3824f7892a9ffd61d12ce02 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:12.187151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:12.187947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:12.188472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:12.213668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da0b9-9a0f-4813-a94c-084c975f9c10 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:12.214233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da0b9-9a0f-4813-a94c-084c975f9c10 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:12.214717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da0b9-9a0f-4813-a94c-084c975f9c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:12.260638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:12.273847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:12.317840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ac9da0b9-9a0f-4813-a94c-084c975f9c10 None None] MFA Rules not processed for user `f4266683d5cd4716b33df6377ffa498b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:12.319876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ac9da0b9-9a0f-4813-a94c-084c975f9c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:12.590475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 876/1718] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:12.591004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 843/1719] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:12.609978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:12.611508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:12.834807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4018f-d434-4063-abae-0b09840090fd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:12.845414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:12.846109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:12.846392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:12.846666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:12.868575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:12.870070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:12.919798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 877/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:13.387643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:14.110186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:14.291410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:14.437156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:14.437990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:14.438808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:14.513211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:14.515007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:14.613805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 844/1721] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:15.249938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:15.252775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:15.267620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:15.270090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:15.297087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc284d8a-bb1c-4299-b9d3-55c0e3913560 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:15.306785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:15.308012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:15.309711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:15.310781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] PATH_INFO: `/v3/projects/867b1ad9d2354a58b942c65a3b5143ce` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:15.312901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] RBAC: Authorizing `identity:delete_project(project_id=867b1ad9d2354a58b942c65a3b5143ce)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:15.316055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:15.495960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867b1ad9d2354a58b942c65a3b5143ce', 'request_id': 'req-9c5d5bbb-007c-48d1-8107-880787b0733e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:15.507354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867b1ad9d2354a58b942c65a3b5143ce', 'request_id': 'req-9c5d5bbb-007c-48d1-8107-880787b0733e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:15.522951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f2e79-fd42-4604-875a-0e7d8f343806 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:15.595199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867b1ad9d2354a58b942c65a3b5143ce', 'request_id': 'req-9c5d5bbb-007c-48d1-8107-880787b0733e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:15.610561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] The token cache is being invalidate because project 867b1ad9d2354a58b942c65a3b5143ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:15.611032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:15.611867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9c5d5bbb-007c-48d1-8107-880787b0733e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:15.614094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 845/1722] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:15 2022] DELETE /identity/v3/projects/867b1ad9d2354a58b942c65a3b5143ce => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:15.619208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636fefa-4440-42ca-8f93-1782a7ee2748 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:15.619647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636fefa-4440-42ca-8f93-1782a7ee2748 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:15.620104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636fefa-4440-42ca-8f93-1782a7ee2748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:15.648154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6636fefa-4440-42ca-8f93-1782a7ee2748 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:15.651027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6636fefa-4440-42ca-8f93-1782a7ee2748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:15.669698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:15.670905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:15.671353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:15.671801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:15.674220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:15.797897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 846/1723] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:15.807303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:15.807605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:15.807882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:15.817334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:15.835641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:15.835641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:15.839880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:15.858420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 847/1724] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:15.859111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:15.876048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 878/1725] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:38:15.909419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5555e0-c50d-42b4-a655-7ebb72d7ce86 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:15.920410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:15.921220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:15.921511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:15.921788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:15.922529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:15.922836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:15.932613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38979c-9acb-462c-ba26-7023bbd32f54 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:15.942321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:15.961400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 848/1726] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:38:15.963035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:15.979367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491a06f-0945-4309-b682-ac81c2d73fd0 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:15.992656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:15.993391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:15.993882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:15.994241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:15.994855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:15.996899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:16.046048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:16.046337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:16.046616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:16.092271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] MFA Rules not processed for user `1b5b8c2d0ea44352b58b4887b5836bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:16.093518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:16.132184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:16.144900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 879/1727] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:15 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:16.154467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:16.235298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 849/1728] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:16.491673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5f3f6-208e-4abc-af3b-b2dff5e39bd5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:16.522931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:16.526747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:16.526747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:16.526747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:16.526747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:16.529225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:16.658645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 880/1729] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:16 2022] POST /identity/v3/users => generated 291 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:16.662771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:16.680693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8abd3-ba83-4b4d-96cb-00d519cfb82d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:16.695485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:16.696633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:16.697136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:16.697648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:16.698578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:16.701008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:16.736261 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 850/1730] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:16.738028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:16.752708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55052-329a-4f9e-86b5-24283ee6b941 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:16.771794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a20c1-8a34-4e8b-a3f3-a94a6fbbba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:16.772032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a20c1-8a34-4e8b-a3f3-a94a6fbbba18 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:16.772424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a20c1-8a34-4e8b-a3f3-a94a6fbbba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:16.772804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a20c1-8a34-4e8b-a3f3-a94a6fbbba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:16.773690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a20c1-8a34-4e8b-a3f3-a94a6fbbba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:16.778286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a20c1-8a34-4e8b-a3f3-a94a6fbbba18 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:16.830088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 881/1731] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:16.836685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:16.858534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc0e6-ab12-4a8d-83cf-572b343306ab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:16.882935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:16.884322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:16.884849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:16.885363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] PATH_INFO: `/v3/projects/36a5ecb53aef405488cf0a1da5b94337/users/8e0ab6ccb69f4b019daffcd45170a107/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:16.937838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a5ecb53aef405488cf0a1da5b94337, user_id=8e0ab6ccb69f4b019daffcd45170a107, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:16.941107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:17.066760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 851/1732] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:16 2022] PUT /identity/v3/projects/36a5ecb53aef405488cf0a1da5b94337/users/8e0ab6ccb69f4b019daffcd45170a107/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:17.071131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:17.071946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:17.071946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:17.165397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] MFA Rules not processed for user `8e0ab6ccb69f4b019daffcd45170a107`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:17.171178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:17.304385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:17.363055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 882/1733] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:17.371349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:17.551537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4585-c942-47e3-981b-2fe97808dd97 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:17.563209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31892055-7e45-435b-955d-8a38aeb8bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:17.564187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31892055-7e45-435b-955d-8a38aeb8bf60 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:17.564609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31892055-7e45-435b-955d-8a38aeb8bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:17.565014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31892055-7e45-435b-955d-8a38aeb8bf60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:17.565815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31892055-7e45-435b-955d-8a38aeb8bf60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:17.568547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31892055-7e45-435b-955d-8a38aeb8bf60 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:17.834871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 852/1734] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:17 2022] POST /identity/v3/projects => generated 381 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:17.835426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:17.835426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45eb12-c8c9-4997-975e-09a0188a8782 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:18.025895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:18.025895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:18.025895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:18.025895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:18.026352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:18.030793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:18.402953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:18.403884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:18.404332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:18.438625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 883/1735] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:17 2022] POST /identity/v3/users => generated 297 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:18.454617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:18.465696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:18.467956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:18.495833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d7fe4-dc92-49eb-9f8c-7a32daabf723 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:18.512259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:18.513726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:18.514232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:18.514683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:18.516735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:18.520574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:18.567118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 884/1736] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:18.568579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:18.625358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea75f-0352-402b-969b-b8422870bf2b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:18.627107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:18.629109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:18.629424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:18.629682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] PATH_INFO: `/v3/projects/f9e7b59d06c949cabdbde89a67e18f4e/users/e02d41d0c9754d8696be0a4bf7b5200f/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:18.630660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 853/1737] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 09:38:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:18.655970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:18.670143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:18.704689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ffbe6-c7d7-4a0a-9f36-5a9969e86166 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:18.713976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e7b59d06c949cabdbde89a67e18f4e, user_id=e02d41d0c9754d8696be0a4bf7b5200f, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:18.714462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:18.719716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:18.720228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:18.722405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:18.726728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:18.774204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:18.778322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:18.803297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 854/1738] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:18.823507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:18.849685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31d6d-b0d7-4d6b-ba1b-e8f01ee27606 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:18.872612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:18.876161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:18.876161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:18.876161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:18.883549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 885/1739] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:18 2022] PUT /identity/v3/projects/f9e7b59d06c949cabdbde89a67e18f4e/users/e02d41d0c9754d8696be0a4bf7b5200f/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:18.885584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:18.891667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:18.895089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:18.907402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 855/1740] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:19.011681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:19.162687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710f052-016b-41dc-a194-993b7b870a63 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:19.227411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4ba86-c299-4843-b77a-fcae4260c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:19.234627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ba86-c299-4843-b77a-fcae4260c467 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:19.237317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ba86-c299-4843-b77a-fcae4260c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:19.237317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ba86-c299-4843-b77a-fcae4260c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:19.241321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ba86-c299-4843-b77a-fcae4260c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:19.245536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ba86-c299-4843-b77a-fcae4260c467 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:19.289879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 886/1741] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:19.294712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:19.337683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524c30-1eec-49a3-beec-e4cd738b6634 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:19.370891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:19.371368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:19.371655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:19.372335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] PATH_INFO: `/v3/projects/f9e7b59d06c949cabdbde89a67e18f4e/users/e02d41d0c9754d8696be0a4bf7b5200f/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:19.375429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e7b59d06c949cabdbde89a67e18f4e, user_id=e02d41d0c9754d8696be0a4bf7b5200f, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:19.378478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:19.411576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 856/1742] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:19 2022] PUT /identity/v3/projects/f9e7b59d06c949cabdbde89a67e18f4e/users/e02d41d0c9754d8696be0a4bf7b5200f/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:19.424659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:19.425725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:19.426546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:19.537595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] MFA Rules not processed for user `e02d41d0c9754d8696be0a4bf7b5200f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:19.544556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:19.849773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 887/1743] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:19.884385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:19.889836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:20.109760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98185b37-3fc2-4fea-bd29-9e1bdc843073 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:20.139060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8486c-8a72-4b30-b854-cf0befb7043e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:20.139060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8486c-8a72-4b30-b854-cf0befb7043e service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:20.139060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8486c-8a72-4b30-b854-cf0befb7043e service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:20.139060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8486c-8a72-4b30-b854-cf0befb7043e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:20.156535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8486c-8a72-4b30-b854-cf0befb7043e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:20.158761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8486c-8a72-4b30-b854-cf0befb7043e service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:20.173237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 857/1744] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:20.268705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:20.611705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:20.629937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54479ec1-d6d1-4f0f-a317-3b517f4bb27e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:20.641200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092d538-98b3-4795-a9a1-ccb8e0a60362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:20.649770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092d538-98b3-4795-a9a1-ccb8e0a60362 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:20.650665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092d538-98b3-4795-a9a1-ccb8e0a60362 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:20.651195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092d538-98b3-4795-a9a1-ccb8e0a60362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:20.950141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092d538-98b3-4795-a9a1-ccb8e0a60362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:20.951975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092d538-98b3-4795-a9a1-ccb8e0a60362 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:20.974366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 888/1745] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:22.196253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050764a-ce7c-49b8-8aa6-60d66c055cbc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:22.196785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050764a-ce7c-49b8-8aa6-60d66c055cbc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:22.196785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050764a-ce7c-49b8-8aa6-60d66c055cbc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:22.198487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 858/1746] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:22.215009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4b9e-1239-434a-875c-3abdb2ee6f63 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:22.217022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4b9e-1239-434a-875c-3abdb2ee6f63 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:22.217516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a4b9e-1239-434a-875c-3abdb2ee6f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:22.334664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b98a4b9e-1239-434a-875c-3abdb2ee6f63 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:22.335959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b98a4b9e-1239-434a-875c-3abdb2ee6f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:22.502232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 889/1747] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:38:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:23.120903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050764a-ce7c-49b8-8aa6-60d66c055cbc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:23.123348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a050764a-ce7c-49b8-8aa6-60d66c055cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:23.188198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050764a-ce7c-49b8-8aa6-60d66c055cbc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:23.205071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325fa57-672e-454d-a58a-62dd8867e438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:23.213525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325fa57-672e-454d-a58a-62dd8867e438 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:23.213525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325fa57-672e-454d-a58a-62dd8867e438 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:23.213525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325fa57-672e-454d-a58a-62dd8867e438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:23.230702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325fa57-672e-454d-a58a-62dd8867e438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:23.236123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325fa57-672e-454d-a58a-62dd8867e438 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:23.276152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 859/1748] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:23.616294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:23.882947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d475c-63e0-4273-aef7-8a345c2ba3b2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:23.882947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d475c-63e0-4273-aef7-8a345c2ba3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:23.882947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d475c-63e0-4273-aef7-8a345c2ba3b2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:23.882947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 890/1749] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:23.898195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:23.898556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:23.899177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:23.956063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:23.958943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:24.007637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 860/1750] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:38:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:24.020803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d475c-63e0-4273-aef7-8a345c2ba3b2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:24.023318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b19d475c-63e0-4273-aef7-8a345c2ba3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:24.044607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d475c-63e0-4273-aef7-8a345c2ba3b2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:24.051594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70702b-12a6-4141-834e-8f59fc8d5a66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:24.052225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70702b-12a6-4141-834e-8f59fc8d5a66 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:24.052526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70702b-12a6-4141-834e-8f59fc8d5a66 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:24.052794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70702b-12a6-4141-834e-8f59fc8d5a66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:24.063502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70702b-12a6-4141-834e-8f59fc8d5a66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:24.065226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70702b-12a6-4141-834e-8f59fc8d5a66 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:24.089216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 891/1751] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:26.116419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:26.125245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:26.225192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7be5e-c3b6-458d-a026-15a7ed69bf7e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:26.233308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:26.234408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:26.234916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:26.235420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] PATH_INFO: `/v3/users/5e60d9c410664053a1e4bf5fb23603a5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:26.237808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e60d9c410664053a1e4bf5fb23603a5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:26.246661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:26.520131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e60d9c410664053a1e4bf5fb23603a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:26.520794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e60d9c410664053a1e4bf5fb23603a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:26.521412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e60d9c410664053a1e4bf5fb23603a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:26.530585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e60d9c410664053a1e4bf5fb23603a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:26.545833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e60d9c410664053a1e4bf5fb23603a5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:26.645741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 861/1752] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:26 2022] DELETE /identity/v3/users/5e60d9c410664053a1e4bf5fb23603a5 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:26.651995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:26.652501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:26.652727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:26.683471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:26.683471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:26.727611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:26.764260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 892/1753] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:26.775018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:26.776892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:26.788093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:26.885690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d2bef-72df-4106-bebf-6ce66ca89198 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:26.890907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:26.891602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:26.891882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:26.892156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:26.905977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:26.907795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:26.935091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 862/1754] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:27.651279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:27.653247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:27.685426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1870-c334-409f-bbec-74b8edfc7b9a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:27.706607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:27.707922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:27.708625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:27.709098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] PATH_INFO: `/v3/projects/42445041ea6743b4a5565374b22478cd` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:27.711385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42445041ea6743b4a5565374b22478cd)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:27.719550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:27.880420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42445041ea6743b4a5565374b22478cd', 'request_id': 'req-5d30ad94-a9a5-4963-ba90-4b626d95ca80'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:27.894251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42445041ea6743b4a5565374b22478cd', 'request_id': 'req-5d30ad94-a9a5-4963-ba90-4b626d95ca80'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.038836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42445041ea6743b4a5565374b22478cd', 'request_id': 'req-5d30ad94-a9a5-4963-ba90-4b626d95ca80'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.053628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] The token cache is being invalidate because project 42445041ea6743b4a5565374b22478cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:28.054389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.055351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.057523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 893/1755] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:27 2022] DELETE /identity/v3/projects/42445041ea6743b4a5565374b22478cd => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:28.061477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:28.072910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1ff0-51f3-4239-b066-8c74a30fbfcd service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:28.217607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:28.220342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:28.220640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:28.220931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] PATH_INFO: `/v3/users/a81b02901be04dda84558d1fa7d21ce9` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:28.224672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81b02901be04dda84558d1fa7d21ce9)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:28.233189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:28.584875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81b02901be04dda84558d1fa7d21ce9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.587701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81b02901be04dda84558d1fa7d21ce9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.588692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81b02901be04dda84558d1fa7d21ce9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.601134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81b02901be04dda84558d1fa7d21ce9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.630428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-43acd85e-4776-4023-91ba-856f8f4e0d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81b02901be04dda84558d1fa7d21ce9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:28.749667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 863/1756] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:28 2022] DELETE /identity/v3/users/a81b02901be04dda84558d1fa7d21ce9 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:30.152773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:30.152773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:30.159844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30ad94-a9a5-4963-ba90-4b626d95ca80 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:30.267775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:30.268744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:30.269544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:30.272334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] PATH_INFO: `/v3/projects/f9127b3ec6f947ac91e65f0ff7d451cc` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:30.274191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9127b3ec6f947ac91e65f0ff7d451cc)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:30.279185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:30.490443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9127b3ec6f947ac91e65f0ff7d451cc', 'request_id': 'req-2e208cb9-3f02-4462-97f4-10fc81488989'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:30.506903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9127b3ec6f947ac91e65f0ff7d451cc', 'request_id': 'req-2e208cb9-3f02-4462-97f4-10fc81488989'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:30.517261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:30.616096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9127b3ec6f947ac91e65f0ff7d451cc', 'request_id': 'req-2e208cb9-3f02-4462-97f4-10fc81488989'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:30.631071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] The token cache is being invalidate because project f9127b3ec6f947ac91e65f0ff7d451cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:30.631707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:30.632147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e208cb9-3f02-4462-97f4-10fc81488989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:30.633894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 894/1757] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:30 2022] DELETE /identity/v3/projects/f9127b3ec6f947ac91e65f0ff7d451cc => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:30.639638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:30.640247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:30.640411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:30.670770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:30.672170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:30.765846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 864/1758] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:30.773869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:30.775670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:30.777254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:30.822096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:30.836792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:30.842097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 895/1759] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:30.846339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:30.860123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c308e-d1dc-4601-8d7f-28b43901b9c6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:30.870421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:30.873194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:30.874303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:30.883220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:30.883220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:30.883220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:30.883220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:30.917651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 865/1760] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:38:30.921968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:30.936348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935af4b-1e26-4594-8644-8f72699ec48b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:30.944998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:30.945915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:30.946509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:30.947009 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:30.947861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:30.951276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:31.142664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 896/1761] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:30 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:31.147252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:31.162972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150f76c-74a2-4d19-a0ba-f24df7138268 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:31.233815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:31.234482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.234794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.235071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.235763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:31.238067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:31.358325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 866/1762] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:31 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:31.369977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:31.385011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e68d8-c9f6-448c-8904-04acd3d28a3b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:31.392290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:31.392902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.396155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.396155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.396155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:31.396155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:31.407393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 897/1763] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:31.411868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:31.422669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b73af-8376-40e0-af4a-839417ad8c1e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:31.428635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa6f7d-752a-4906-bec5-17a352812b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:31.437126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6f7d-752a-4906-bec5-17a352812b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.437126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6f7d-752a-4906-bec5-17a352812b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.437126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa6f7d-752a-4906-bec5-17a352812b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.437126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6f7d-752a-4906-bec5-17a352812b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:31.437126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa6f7d-752a-4906-bec5-17a352812b0a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:31.445900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 867/1764] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:31.450697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:31.462816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12125a5c-7f36-49c9-ba66-16c55cc701f9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:31.470935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:31.471126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.473008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.473008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] PATH_INFO: `/v3/projects/b7beec02d12144efbad1102d7414d622/users/ca268dbbb0bd4380b4c656bf85840bd6/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.491414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7beec02d12144efbad1102d7414d622, user_id=ca268dbbb0bd4380b4c656bf85840bd6, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:31.494987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:31.581989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 898/1765] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:31 2022] PUT /identity/v3/projects/b7beec02d12144efbad1102d7414d622/users/ca268dbbb0bd4380b4c656bf85840bd6/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:31.594083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.596468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.596468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.628427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] MFA Rules not processed for user `ca268dbbb0bd4380b4c656bf85840bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:31.632360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:31.707978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 868/1766] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:31.712702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:31.785161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c2dcf-b772-4777-ae3a-77854b45cc69 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:31.789827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:31.790584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.790874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.791141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.791802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:31.794633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.053916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 899/1767] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:31 2022] POST /identity/v3/projects => generated 387 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:32.058064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:32.070112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d66c29-8446-44c7-9e9b-db9784519614 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:32.164245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:32.165032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.165751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.166129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.166956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:32.172165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.418782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 869/1768] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:32 2022] POST /identity/v3/users => generated 300 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:32.424572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:32.440463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c623a-d008-4f40-9443-c14daf2bc4ef admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:32.470714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:32.471366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.471650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.471923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.472673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:32.474384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.517893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 900/1769] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:32.519162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:32.536873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4a346-2c3c-41b9-a945-25331c41aa1e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:32.564785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:32.565048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.566776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.567072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] PATH_INFO: `/v3/projects/67a2161969424a81a98b721a392bcab8/users/b8128583bc9c46c4922ff77e61cf4afe/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.613964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a2161969424a81a98b721a392bcab8, user_id=b8128583bc9c46c4922ff77e61cf4afe, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:32.617898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.722577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 870/1770] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:32 2022] PUT /identity/v3/projects/67a2161969424a81a98b721a392bcab8/users/b8128583bc9c46c4922ff77e61cf4afe/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:32.726524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:32.738183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d4bea-09c5-493c-838e-5bb97784d222 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:32.851549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07190a-432a-4b1b-ad54-6e57a23692c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:32.852307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07190a-432a-4b1b-ad54-6e57a23692c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.852648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07190a-432a-4b1b-ad54-6e57a23692c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.852991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07190a-432a-4b1b-ad54-6e57a23692c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.853713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07190a-432a-4b1b-ad54-6e57a23692c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:32.856155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07190a-432a-4b1b-ad54-6e57a23692c1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.860899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:32.874076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 901/1771] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:32.874236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:32.884448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b044-c2e8-446a-964e-e6a61a2d8163 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:32.890922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:32.892510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.892977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.893555 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] PATH_INFO: `/v3/projects/67a2161969424a81a98b721a392bcab8/users/b8128583bc9c46c4922ff77e61cf4afe/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.895863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a2161969424a81a98b721a392bcab8, user_id=b8128583bc9c46c4922ff77e61cf4afe, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:32.899025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.919426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 871/1772] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:32 2022] PUT /identity/v3/projects/67a2161969424a81a98b721a392bcab8/users/b8128583bc9c46c4922ff77e61cf4afe/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:32.923664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.924217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.924759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.962411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] MFA Rules not processed for user `b8128583bc9c46c4922ff77e61cf4afe`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:32.965560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:33.051737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 902/1773] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:33.063350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:33.065387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:33.131030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1606eb-c448-4a0d-ae22-ac203db7400d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:33.134888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241e7a8-6482-4512-9875-a39ed9ffcc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:33.135359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e7a8-6482-4512-9875-a39ed9ffcc59 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:33.135641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e7a8-6482-4512-9875-a39ed9ffcc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:33.135917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241e7a8-6482-4512-9875-a39ed9ffcc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:33.146127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241e7a8-6482-4512-9875-a39ed9ffcc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:33.147859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241e7a8-6482-4512-9875-a39ed9ffcc59 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:33.158497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 872/1774] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:33.227681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:33.290711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc3ac7-05f8-48da-801f-e183cf1f4dce None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:33.295305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:33.296546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:33.296828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:33.297095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] PATH_INFO: `/v3/users/ca268dbbb0bd4380b4c656bf85840bd6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:33.298430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca268dbbb0bd4380b4c656bf85840bd6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:33.300358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:33.605909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca268dbbb0bd4380b4c656bf85840bd6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:33.809358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca268dbbb0bd4380b4c656bf85840bd6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:33.810794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca268dbbb0bd4380b4c656bf85840bd6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:33.836152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca268dbbb0bd4380b4c656bf85840bd6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:33.838732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca268dbbb0bd4380b4c656bf85840bd6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:33.902696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 903/1775] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:33 2022] DELETE /identity/v3/users/ca268dbbb0bd4380b4c656bf85840bd6 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:33.908217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:33.908739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:33.908817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:33.944772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:33.944772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:34.062096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 873/1776] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:34.077241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:34.078982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:34.160995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f298-63e2-42b2-9950-2a88631bc9ce admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:34.167630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848500-d038-4cc9-ae5b-588fd6918ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:34.168312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848500-d038-4cc9-ae5b-588fd6918ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:34.168635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848500-d038-4cc9-ae5b-588fd6918ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:34.169744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848500-d038-4cc9-ae5b-588fd6918ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:34.181507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848500-d038-4cc9-ae5b-588fd6918ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:34.183048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848500-d038-4cc9-ae5b-588fd6918ee2 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:34.213438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 904/1777] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:36.309702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:36.311884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.328988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ca9c8-ded8-4954-83f6-400c721f697a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:36.341838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:36.342662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.343036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.343394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] PATH_INFO: `/v3/projects/b7beec02d12144efbad1102d7414d622` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.344611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7beec02d12144efbad1102d7414d622)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:36.346574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:36.491818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7beec02d12144efbad1102d7414d622', 'request_id': 'req-a41190c7-9088-4fa2-8929-ac2aa46548cb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:36.501351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7beec02d12144efbad1102d7414d622', 'request_id': 'req-a41190c7-9088-4fa2-8929-ac2aa46548cb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:36.655315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626d37-398b-411c-aa35-79eac038152f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.656302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626d37-398b-411c-aa35-79eac038152f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.656930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626d37-398b-411c-aa35-79eac038152f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.658624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 905/1778] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:36.682099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.682099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.682099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.716324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:36.718312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.719430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7beec02d12144efbad1102d7414d622', 'request_id': 'req-a41190c7-9088-4fa2-8929-ac2aa46548cb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:36.737331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] The token cache is being invalidate because project b7beec02d12144efbad1102d7414d622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:36.737629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:36.738585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:36.740652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 874/1779] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:36 2022] DELETE /identity/v3/projects/b7beec02d12144efbad1102d7414d622 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:36.744756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:36.746516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.798599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 906/1780] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:38:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:36.815303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:36.816736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.829250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41190c7-9088-4fa2-8929-ac2aa46548cb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:36.832671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ebe7-3a12-4aab-ace6-a4c682791347 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:36.840317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:36.841508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.842052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:36.842331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.842614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] PATH_INFO: `/v3/users/b8128583bc9c46c4922ff77e61cf4afe` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.842898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.842898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.843382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.844061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8128583bc9c46c4922ff77e61cf4afe)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:36.846099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:36.855463 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:36.857680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:36.868874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 907/1781] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:37.078788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8128583bc9c46c4922ff77e61cf4afe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:37.079853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8128583bc9c46c4922ff77e61cf4afe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:37.081107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8128583bc9c46c4922ff77e61cf4afe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:37.094850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8128583bc9c46c4922ff77e61cf4afe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:37.123541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8128583bc9c46c4922ff77e61cf4afe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:37.226539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 875/1782] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:36 2022] DELETE /identity/v3/users/b8128583bc9c46c4922ff77e61cf4afe => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:37.816764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:37.837792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6a59-7c30-42a1-ad0a-6f916af36494 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:37.947296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:37.948054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:37.948573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:37.949060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] PATH_INFO: `/v3/projects/67a2161969424a81a98b721a392bcab8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:37.951661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a2161969424a81a98b721a392bcab8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:37.954010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.074526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a2161969424a81a98b721a392bcab8', 'request_id': 'req-95d29ecc-5f8c-4082-8599-f102f2acd13a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.081161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a2161969424a81a98b721a392bcab8', 'request_id': 'req-95d29ecc-5f8c-4082-8599-f102f2acd13a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.132778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.134438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.152672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b68fb2-21db-4fd4-8ac3-5ced7591c2b3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.209308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a2161969424a81a98b721a392bcab8', 'request_id': 'req-95d29ecc-5f8c-4082-8599-f102f2acd13a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.226606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] The token cache is being invalidate because project 67a2161969424a81a98b721a392bcab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:38.227084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.228084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-95d29ecc-5f8c-4082-8599-f102f2acd13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.229963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 908/1783] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:37 2022] DELETE /identity/v3/projects/67a2161969424a81a98b721a392bcab8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:38.236228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b030f-8f1f-48fe-944d-82ee79c023d5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.236441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b030f-8f1f-48fe-944d-82ee79c023d5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.236681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b030f-8f1f-48fe-944d-82ee79c023d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.242902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.244330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.244853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.245227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] PATH_INFO: `/v3/users/8e0ab6ccb69f4b019daffcd45170a107` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.248299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0ab6ccb69f4b019daffcd45170a107)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.251373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.261607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e98b030f-8f1f-48fe-944d-82ee79c023d5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:38.263629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e98b030f-8f1f-48fe-944d-82ee79c023d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.281944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 909/1784] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:38.283555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.283904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.284240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.306534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:38.312572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.319266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 910/1785] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:38.323731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.333638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846d349-9046-48d0-bf01-16a73e8b8186 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.337182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:38.342761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.343480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.343793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.347515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.347515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:38.347515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.347515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.372607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 911/1786] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:38:38.374035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.385631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6141de-8986-4256-b8e6-1c0a08ea07e4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.392227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.392937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.393284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.393644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.394378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.397679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.469253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0ab6ccb69f4b019daffcd45170a107'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.470438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0ab6ccb69f4b019daffcd45170a107'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.471242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0ab6ccb69f4b019daffcd45170a107'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.480162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0ab6ccb69f4b019daffcd45170a107'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.506567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2cbd518-aa22-4929-b54f-bf418e075ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0ab6ccb69f4b019daffcd45170a107'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:38.524092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 912/1787] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:38 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:38.536258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.539312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.583105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 876/1788] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:38 2022] DELETE /identity/v3/users/8e0ab6ccb69f4b019daffcd45170a107 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:38.588960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.589408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.589692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.612511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:38.613789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.640272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78797-f5df-461e-9607-b0bff6fc5dc7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.717215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 877/1789] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:38.728315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.730140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.741403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.742587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.742730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.743051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.743851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.746163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.798567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf7194-1d7c-461e-bec5-73c84eb5c639 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.802126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.802730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.803024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.803278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.812542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.814027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.823479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 878/1790] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:38.853549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 913/1791] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:38 2022] POST /identity/v3/users => generated 300 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:38.854884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.867102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b45b24-21f3-40ce-bab4-91152c345bf6 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.873737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.874421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.874701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.878273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.878273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.878273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.893150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 879/1792] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:38.897806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.911213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5d6df-1156-46b3-85fa-5ec52a8b2882 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.924276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9934ee2-c843-4014-b5c3-f734a7942d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.924276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934ee2-c843-4014-b5c3-f734a7942d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.924276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934ee2-c843-4014-b5c3-f734a7942d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.924276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934ee2-c843-4014-b5c3-f734a7942d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.924624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9934ee2-c843-4014-b5c3-f734a7942d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.925435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9934ee2-c843-4014-b5c3-f734a7942d0b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.939174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 914/1793] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:38.944102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.960294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe1663-cd63-4d00-b281-2f0e0e4525bf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.966111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.966783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.967062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.967350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] PATH_INFO: `/v3/projects/1d74bdd601594e1fa595b4eb9bdbe4c5/users/2817e164c7bf4c998c0b528d57a7343d/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.986032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d74bdd601594e1fa595b4eb9bdbe4c5, user_id=2817e164c7bf4c998c0b528d57a7343d, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.988718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:39.077895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 880/1794] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:38 2022] PUT /identity/v3/projects/1d74bdd601594e1fa595b4eb9bdbe4c5/users/2817e164c7bf4c998c0b528d57a7343d/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:39.094980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.095276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.095536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.143800 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] MFA Rules not processed for user `2817e164c7bf4c998c0b528d57a7343d`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:39.145227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.257296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 915/1795] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:39.262296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:39.343842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f074e-db1a-4ced-a675-53e04fb43dff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:39.350960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:39.354418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.354418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.354418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.354418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:39.355815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:39.358549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:39.362006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.407016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b17ed-cad9-4445-be2f-64d33948bf9b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:39.412184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:39.412876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.413170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.413451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] PATH_INFO: `/v3/projects/36a5ecb53aef405488cf0a1da5b94337` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.414647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a5ecb53aef405488cf0a1da5b94337)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:39.416571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:39.543165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 881/1796] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:39 2022] POST /identity/v3/projects => generated 401 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:39.547847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:39.549607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.594533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a5ecb53aef405488cf0a1da5b94337', 'request_id': 'req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:39.601976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a5ecb53aef405488cf0a1da5b94337', 'request_id': 'req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:39.652474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa69bc-4d97-45ad-bbea-8cf4cf6c6937 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:39.702314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a5ecb53aef405488cf0a1da5b94337', 'request_id': 'req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:39.719281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] The token cache is being invalidate because project 36a5ecb53aef405488cf0a1da5b94337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:39.719578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:39.721548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:39.723415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 916/1797] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:39 2022] DELETE /identity/v3/projects/36a5ecb53aef405488cf0a1da5b94337 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:39.726875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:39.729163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:39.729926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.730535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.730748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] PATH_INFO: `/v3/users/eded5f7548af4f0f8f80bf26bde7b2c5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.732862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eded5f7548af4f0f8f80bf26bde7b2c5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:39.735080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.735429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:39.758045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae55a22-3a72-49b8-b1e7-6e994bc653e7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:39.766874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:39.767542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.767779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.768061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.768704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:39.771409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:39.880836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 917/1798] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:39 2022] POST /identity/v3/users => generated 307 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:39.882635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:39.886403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.902875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371015f0-908e-4d8d-83df-bce36ad14016 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:39.911260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:39.914997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.914997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.914997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] PATH_INFO: `/v3/users/e02d41d0c9754d8696be0a4bf7b5200f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.914997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02d41d0c9754d8696be0a4bf7b5200f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:39.915831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.015819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eded5f7548af4f0f8f80bf26bde7b2c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.017402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eded5f7548af4f0f8f80bf26bde7b2c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.018132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eded5f7548af4f0f8f80bf26bde7b2c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.027053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eded5f7548af4f0f8f80bf26bde7b2c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.044339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eded5f7548af4f0f8f80bf26bde7b2c5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.153052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 882/1799] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:39 2022] DELETE /identity/v3/users/eded5f7548af4f0f8f80bf26bde7b2c5 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:40.156291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.158990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:40.160271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.163533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02d41d0c9754d8696be0a4bf7b5200f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.242257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101293-e819-4d24-90a6-eee795c6597a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:40.243229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02d41d0c9754d8696be0a4bf7b5200f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.244222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02d41d0c9754d8696be0a4bf7b5200f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.249092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd7ea-e25f-4abd-8187-26b001f4d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:40.250548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd7ea-e25f-4abd-8187-26b001f4d377 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.250548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd7ea-e25f-4abd-8187-26b001f4d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.250548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd7ea-e25f-4abd-8187-26b001f4d377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.251513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd7ea-e25f-4abd-8187-26b001f4d377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:40.254157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd7ea-e25f-4abd-8187-26b001f4d377 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.267595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 883/1800] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:40.270409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02d41d0c9754d8696be0a4bf7b5200f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.271488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02d41d0c9754d8696be0a4bf7b5200f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:40.273980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fc66-288e-4867-a696-d520280d877f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.274552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fc66-288e-4867-a696-d520280d877f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.275056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fc66-288e-4867-a696-d520280d877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.286817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 918/1801] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:39 2022] DELETE /identity/v3/users/e02d41d0c9754d8696be0a4bf7b5200f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:40.290528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.295839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.312217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f056fc66-288e-4867-a696-d520280d877f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:40.314029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f056fc66-288e-4867-a696-d520280d877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.405437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594804-e50f-4845-a914-3f8c478fd536 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:40.412787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:40.415010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.415471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.416368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] PATH_INFO: `/v3/projects/b9ba860dbcbc48848d60918e3b0d1088/users/0d5e7be31f254d98951779d02f593f6a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.459752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ba860dbcbc48848d60918e3b0d1088, user_id=0d5e7be31f254d98951779d02f593f6a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:40.464808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.494614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 884/1802] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:40.503152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056fc66-288e-4867-a696-d520280d877f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.505876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f056fc66-288e-4867-a696-d520280d877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.580973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056fc66-288e-4867-a696-d520280d877f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:40.588046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:40.590659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.591815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.592283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.601968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 919/1803] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:40 2022] PUT /identity/v3/projects/b9ba860dbcbc48848d60918e3b0d1088/users/0d5e7be31f254d98951779d02f593f6a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:40.603314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.624289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:40.625549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.636932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 885/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:40.692842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e5ec2-d0f5-4135-b60f-08b37cb3eb3d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:40.700702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c5a5e-4b7e-4d5b-b0ab-b88bec55741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:40.701657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c5a5e-4b7e-4d5b-b0ab-b88bec55741e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.702145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c5a5e-4b7e-4d5b-b0ab-b88bec55741e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.702596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c5a5e-4b7e-4d5b-b0ab-b88bec55741e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.703406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c5a5e-4b7e-4d5b-b0ab-b88bec55741e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:40.705342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c5a5e-4b7e-4d5b-b0ab-b88bec55741e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.722913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 920/1805] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:40.724093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.739985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bbfbb-08ea-4f3d-92ea-ad1aacbca773 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:40.745470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:40.749418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.749418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.749418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] PATH_INFO: `/v3/projects/b9ba860dbcbc48848d60918e3b0d1088/users/0d5e7be31f254d98951779d02f593f6a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.750626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ba860dbcbc48848d60918e3b0d1088, user_id=0d5e7be31f254d98951779d02f593f6a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:40.753481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.773966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 886/1806] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:40 2022] PUT /identity/v3/projects/b9ba860dbcbc48848d60918e3b0d1088/users/0d5e7be31f254d98951779d02f593f6a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:40.777089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.777738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.778461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.822147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] MFA Rules not processed for user `0d5e7be31f254d98951779d02f593f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:40.823697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.954407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.956281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.971611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 921/1807] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:40 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:40.983238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:40.985263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.060492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4ca80-1acc-41b8-868c-e556e48cd78a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.066835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.069464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.069464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.069464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] PATH_INFO: `/v3/projects/f9e7b59d06c949cabdbde89a67e18f4e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.069464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e7b59d06c949cabdbde89a67e18f4e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.071183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.078487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c07128-509e-4f69-8f76-43f427d1ebb6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.083353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.084414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.084414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.084603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.098616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.100974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.112241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 922/1808] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:41.235874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e7b59d06c949cabdbde89a67e18f4e', 'request_id': 'req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.243005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e7b59d06c949cabdbde89a67e18f4e', 'request_id': 'req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.252886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:41.254490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.291904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4f361-8cb1-438b-92c1-0e6deb38835c service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.366902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.367800 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.368222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.368492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] PATH_INFO: `/v3/projects/89f4338b66754b41be26b8b4be2a5e59` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.369799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f4338b66754b41be26b8b4be2a5e59)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.373686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.377151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e7b59d06c949cabdbde89a67e18f4e', 'request_id': 'req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.400145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] The token cache is being invalidate because project f9e7b59d06c949cabdbde89a67e18f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:41.400565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.402528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.408322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 887/1809] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:40 2022] DELETE /identity/v3/projects/f9e7b59d06c949cabdbde89a67e18f4e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:41.412965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:41.425445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.521248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f4338b66754b41be26b8b4be2a5e59', 'request_id': 'req-a1da9e3e-1120-49b9-a26f-7415a69b038c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.526590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e26fa-2c77-44f2-8d6a-3d17a52a0ad4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.532278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f4338b66754b41be26b8b4be2a5e59', 'request_id': 'req-a1da9e3e-1120-49b9-a26f-7415a69b038c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.597490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.598268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.598554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.598837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.600932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.632045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f4338b66754b41be26b8b4be2a5e59', 'request_id': 'req-a1da9e3e-1120-49b9-a26f-7415a69b038c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.646264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] The token cache is being invalidate because project 89f4338b66754b41be26b8b4be2a5e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:41.647076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.647794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a1da9e3e-1120-49b9-a26f-7415a69b038c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:41.649687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 923/1810] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:41 2022] DELETE /identity/v3/projects/89f4338b66754b41be26b8b4be2a5e59 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:41.654368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626551ab-4301-4ecc-b410-023e85c58eb6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.654728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626551ab-4301-4ecc-b410-023e85c58eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.655014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626551ab-4301-4ecc-b410-023e85c58eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.677960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-626551ab-4301-4ecc-b410-023e85c58eb6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:41.679279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-626551ab-4301-4ecc-b410-023e85c58eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.698679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.702393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.715385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 888/1811] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:41.716873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:41.722566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.793707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 924/1812] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:41.802461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.802461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.802461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.802724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e163f-ace2-47fc-bbb9-5bb660b244f9 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.807639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.808410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.808704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.809028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] PATH_INFO: `/v3/users/517434cd4f494800ad19a9f589c33eb4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.810627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517434cd4f494800ad19a9f589c33eb4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.812789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.847367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:41.848777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.868646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:41.879506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 925/1813] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:41.884187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:41.894927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7948b1e-0c9c-4e1c-aec2-c0b681ec7dc2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.901426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.902336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.902858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.903290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.904351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:41.904871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.907336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.925195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 926/1814] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:38:41.926477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:41.938138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540d2ff-02ae-40b6-83d1-61de6056fa9c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.943136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.943756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.944203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.944652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.945315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.947289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:42.051413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 927/1815] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:41 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:42.056115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.112500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517434cd4f494800ad19a9f589c33eb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:42.113205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517434cd4f494800ad19a9f589c33eb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:42.113942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517434cd4f494800ad19a9f589c33eb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:42.130505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517434cd4f494800ad19a9f589c33eb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:42.145113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669521a-ccf0-4962-a4cb-9e09a785a8d6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.149747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517434cd4f494800ad19a9f589c33eb4'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:42.158524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.159325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.159753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.160038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.160717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:42.163450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:42.243388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 889/1816] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:41 2022] DELETE /identity/v3/users/517434cd4f494800ad19a9f589c33eb4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:42.308254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 928/1817] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:42 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:42.314403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.316845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:42.404176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2ec1-0b2c-46c2-a9fc-be3f37164be2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.409095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.410521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.411183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.411485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.412219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:42.414207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:42.430345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 890/1818] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:42.435210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.447238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da7553-1e0a-483b-a4e9-a953881af3fd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.454189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436277b-753c-4cfd-b8ea-f9f3b4af7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.455345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436277b-753c-4cfd-b8ea-f9f3b4af7359 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.455920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436277b-753c-4cfd-b8ea-f9f3b4af7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.456369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436277b-753c-4cfd-b8ea-f9f3b4af7359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.457199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436277b-753c-4cfd-b8ea-f9f3b4af7359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:42.459107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436277b-753c-4cfd-b8ea-f9f3b4af7359 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:42.478977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 929/1819] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:42.483098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.514623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae4d08-4a74-4f3e-8883-f843d5a82237 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.520707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.522494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.523002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.523432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] PATH_INFO: `/v3/projects/b4d8bf14cffb4e86acca137f6c1e03a2/users/dcff9d42f68348748606a8a1314944b3/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.574575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4d8bf14cffb4e86acca137f6c1e03a2, user_id=dcff9d42f68348748606a8a1314944b3, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:42.577832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:42.695866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 891/1820] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:42 2022] PUT /identity/v3/projects/b4d8bf14cffb4e86acca137f6c1e03a2/users/dcff9d42f68348748606a8a1314944b3/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:42.707965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.708270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.708548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.768348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] MFA Rules not processed for user `dcff9d42f68348748606a8a1314944b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:42.769737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:42.823612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.825326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:42.876212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 930/1821] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:42.879321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.939080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ff8cb-fcf3-4a83-8c4e-f1b2871b924d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.944611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.945381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.945587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.945898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] PATH_INFO: `/v3/projects/451c25e7b7804b549649b7915fe66087` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.947098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451c25e7b7804b549649b7915fe66087)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:42.949097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:42.977164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a40861-00be-49e8-b785-8e77dc71d55a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.982921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.983544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.983851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.984550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.985192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:42.987152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.086808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 931/1822] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:42 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:43.091037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.098178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451c25e7b7804b549649b7915fe66087', 'request_id': 'req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:43.104997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451c25e7b7804b549649b7915fe66087', 'request_id': 'req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:43.169235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc2da-3931-4993-a4cc-86f0b4099a77 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.170150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:43.176187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.186350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.186350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.186350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.186350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.186350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.243077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451c25e7b7804b549649b7915fe66087', 'request_id': 'req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:43.259135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] The token cache is being invalidate because project 451c25e7b7804b549649b7915fe66087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:43.259603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:43.260422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d09751b9-1e3a-47e5-a3ad-f7f47bc33407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:43.262879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 892/1823] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:42 2022] DELETE /identity/v3/projects/451c25e7b7804b549649b7915fe66087 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:43.267702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19fcb-c704-4892-a05e-c944b5035bdb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.268677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19fcb-c704-4892-a05e-c944b5035bdb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.269087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19fcb-c704-4892-a05e-c944b5035bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.290632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8be19fcb-c704-4892-a05e-c944b5035bdb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:43.291835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8be19fcb-c704-4892-a05e-c944b5035bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:43.300818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 893/1824] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:43.307199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 932/1825] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:43 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:43.316120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.316120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.316120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.319239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.321219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:43.331459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:43.332969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:43.336636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078f66-870e-4c02-b271-990925c66280 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.343311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 894/1826] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:43.343739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.344375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.344657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.344932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.345585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.347481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.348058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.358775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934939c6-c4b8-4885-8e8c-a220d97527b2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.364487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 933/1827] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:43.365130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.365835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.366158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.366472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.367156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:43.367616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.369738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.370867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.383727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0d21-598d-4fce-8582-b6f630e5f906 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.405713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 895/1828] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:38:43.406764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.417213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7f742-dc71-4b24-8b92-ac9010ecdfee admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.423491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.424190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.430694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.430694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.430694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.431153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.431153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.431428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.431570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] PATH_INFO: `/v3/projects/83d635cb42834c8789ed4622c1f6643f/users/7ac48b68fdd0416182ae57aa2f40a569/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.431713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.451909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d635cb42834c8789ed4622c1f6643f, user_id=7ac48b68fdd0416182ae57aa2f40a569, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.454677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.543018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 896/1829] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:43 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:43.548151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.587903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 934/1830] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:43 2022] PUT /identity/v3/projects/83d635cb42834c8789ed4622c1f6643f/users/7ac48b68fdd0416182ae57aa2f40a569/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:43.591441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.658743 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83038a9-8236-420f-947a-abf55d6ecda9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.713128 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd82aaa-85f7-4561-9e3d-e95669dbd4e7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.722980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.723639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.723973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.724353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.725078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.732113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.745305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 935/1831] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:43.750529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.757260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.758564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.758852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.759407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.760105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.768343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.768525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523841eb-4ff5-4c31-a940-74ff22dd78e1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.772270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca444d-1e43-40ff-9204-fb931e3ed0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.773146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca444d-1e43-40ff-9204-fb931e3ed0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.773428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca444d-1e43-40ff-9204-fb931e3ed0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.773703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca444d-1e43-40ff-9204-fb931e3ed0d5 admin admin] PATH_INFO: `/v3/projects/83d635cb42834c8789ed4622c1f6643f/users/7ac48b68fdd0416182ae57aa2f40a569/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.775934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca444d-1e43-40ff-9204-fb931e3ed0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d635cb42834c8789ed4622c1f6643f, user_id=7ac48b68fdd0416182ae57aa2f40a569, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.779267 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca444d-1e43-40ff-9204-fb931e3ed0d5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.791477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 936/1832] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:43 2022] PUT /identity/v3/projects/83d635cb42834c8789ed4622c1f6643f/users/7ac48b68fdd0416182ae57aa2f40a569/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:43.807490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.807776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.808095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.844926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] MFA Rules not processed for user `7ac48b68fdd0416182ae57aa2f40a569`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:43.846171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:43.890336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 897/1833] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:43 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:43.894434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.907453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f6036-3520-44f6-a653-4ad0fa17c23a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:43.940771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 937/1834] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:43.952738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:43.954385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:43.995972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:43.997525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:43.997983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:43.998372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:43.999114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.001321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.012133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 898/1835] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:44.017147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.029549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907355e7-2705-408a-a1f8-7b79e12d8d36 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.034967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.035586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.036921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.036921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.036921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.038522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.054977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 899/1836] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:44.057245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.060321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917d82-291c-426d-87b5-d64a3933d09b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.066423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.067143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.067440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.067718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.070530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05a4a3-a73f-4ce9-bcb0-6904ee3a5ae4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.077940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df9314-c2d9-41cd-9b5f-7223e5451a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.078977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df9314-c2d9-41cd-9b5f-7223e5451a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.078977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df9314-c2d9-41cd-9b5f-7223e5451a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.079177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df9314-c2d9-41cd-9b5f-7223e5451a15 admin admin] PATH_INFO: `/v3/projects/cb06b6efcbab48b0a90583a05b2a53b0/users/b84aedc66e354a93acd48ee4969abc78/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.083298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.086624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.099438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df9314-c2d9-41cd-9b5f-7223e5451a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb06b6efcbab48b0a90583a05b2a53b0, user_id=b84aedc66e354a93acd48ee4969abc78, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.102545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df9314-c2d9-41cd-9b5f-7223e5451a15 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.103409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 938/1837] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:44.146042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.160162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f1717-249b-4a30-801a-48cafb397e78 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.164842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.165478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.165760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.166074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] PATH_INFO: `/v3/users/dcff9d42f68348748606a8a1314944b3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.167322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcff9d42f68348748606a8a1314944b3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.169917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.226284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 900/1838] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:44 2022] PUT /identity/v3/projects/cb06b6efcbab48b0a90583a05b2a53b0/users/b84aedc66e354a93acd48ee4969abc78/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:44.235765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.235908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.236151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.283755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] MFA Rules not processed for user `b84aedc66e354a93acd48ee4969abc78`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:44.285164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:44.416155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 901/1839] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:44.417922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.447760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcff9d42f68348748606a8a1314944b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:44.552881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5afa8-5487-4d5a-8c86-85d8f3a5c12a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.570693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.571521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.571702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.572068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.575840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.580334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcff9d42f68348748606a8a1314944b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:44.580520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.580987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcff9d42f68348748606a8a1314944b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:44.609801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcff9d42f68348748606a8a1314944b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:44.611058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3e3ff92c-03a0-433f-a931-8c51452993d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcff9d42f68348748606a8a1314944b3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:44.627162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 939/1840] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:44 2022] DELETE /identity/v3/users/dcff9d42f68348748606a8a1314944b3 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:44.631836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376259-4623-4530-827b-c8f4db79facd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.632538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376259-4623-4530-827b-c8f4db79facd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.632824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376259-4623-4530-827b-c8f4db79facd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.653839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d376259-4623-4530-827b-c8f4db79facd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:44.654740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d376259-4623-4530-827b-c8f4db79facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:44.693159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 902/1841] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:44 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:44.703600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.708063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:44.737373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 940/1842] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:44.746056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376259-4623-4530-827b-c8f4db79facd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.748344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d376259-4623-4530-827b-c8f4db79facd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:44.762214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:44.848131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df382a40-1286-49d4-a2ed-4097e2b2b679 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.848552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376259-4623-4530-827b-c8f4db79facd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.853624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.860531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.862847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.862847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.862847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.864070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:44.951315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 903/1843] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:44 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:44.952785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:44.967752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fda0a9-ca18-4fa4-b939-bad435e02240 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:44.969062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.970418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.971181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.972137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.996578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:44.998002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.998215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:44.999108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.999587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.000004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.000861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.002760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.011481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:45.017333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 904/1844] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:45.020920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 941/1845] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:45.024231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:45.062189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4ff77-809c-4af7-bbb1-d1551f84d1cf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:45.074198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:45.075922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.076404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.076808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] PATH_INFO: `/v3/projects/abdb2c412025435ea5130ee82d3b3360/users/3fb89a3847ab40f588135c47f38be565/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.102441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdb2c412025435ea5130ee82d3b3360, user_id=3fb89a3847ab40f588135c47f38be565, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.108322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.215703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 905/1846] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:45 2022] PUT /identity/v3/projects/abdb2c412025435ea5130ee82d3b3360/users/3fb89a3847ab40f588135c47f38be565/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:45.220606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:45.230569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa315116-2301-407a-89f2-d873b13a65eb service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:45.295591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c308b-8a04-4b99-9ecc-57a959abb9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:45.296661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c308b-8a04-4b99-9ecc-57a959abb9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.297084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c308b-8a04-4b99-9ecc-57a959abb9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.297548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c308b-8a04-4b99-9ecc-57a959abb9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.298870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c308b-8a04-4b99-9ecc-57a959abb9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.301952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c308b-8a04-4b99-9ecc-57a959abb9f1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.329388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:45.338122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 942/1847] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:45.349819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eb2bf-e7cd-4645-a432-5ce2c209c2e4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:45.370832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:45.370832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.370832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.370832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] PATH_INFO: `/v3/projects/abdb2c412025435ea5130ee82d3b3360/users/3fb89a3847ab40f588135c47f38be565/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.371502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdb2c412025435ea5130ee82d3b3360, user_id=3fb89a3847ab40f588135c47f38be565, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.371502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.391485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 906/1848] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:45 2022] PUT /identity/v3/projects/abdb2c412025435ea5130ee82d3b3360/users/3fb89a3847ab40f588135c47f38be565/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:45.403549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.404242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.404871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.443893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] MFA Rules not processed for user `3fb89a3847ab40f588135c47f38be565`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:45.445327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.551191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 943/1849] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:45.564923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:45.567426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.600598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:45.602276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.691672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9080f1-4397-47d4-8eb7-2ac7c00d3225 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:45.710253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:45.712069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.712712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.713602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.716165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.717127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8331cf-60c4-4ec2-8756-df791a4fc732 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:45.723215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:45.724196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.724678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.725182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] PATH_INFO: `/v3/projects/b4d8bf14cffb4e86acca137f6c1e03a2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.726603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4d8bf14cffb4e86acca137f6c1e03a2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.728815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.835589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.837032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.849656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 907/1850] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:45.882775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4d8bf14cffb4e86acca137f6c1e03a2', 'request_id': 'req-364e6a88-c647-4a75-b184-2cbd3a6fef75'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:45.891678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4d8bf14cffb4e86acca137f6c1e03a2', 'request_id': 'req-364e6a88-c647-4a75-b184-2cbd3a6fef75'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:45.976537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4d8bf14cffb4e86acca137f6c1e03a2', 'request_id': 'req-364e6a88-c647-4a75-b184-2cbd3a6fef75'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:45.996894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] The token cache is being invalidate because project b4d8bf14cffb4e86acca137f6c1e03a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:46.007929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.007929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.007929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 944/1851] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:45 2022] DELETE /identity/v3/projects/b4d8bf14cffb4e86acca137f6c1e03a2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:46.010391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:46.029098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ed6d7-54b5-4cb4-b433-9214a1a0dfe2 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:46.138840 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:46.139778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:46.140246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:46.140752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] PATH_INFO: `/v3/users/7ac48b68fdd0416182ae57aa2f40a569` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:46.142335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac48b68fdd0416182ae57aa2f40a569)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:46.144424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:46.237313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:46.427355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac48b68fdd0416182ae57aa2f40a569'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.427834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac48b68fdd0416182ae57aa2f40a569'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.428791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac48b68fdd0416182ae57aa2f40a569'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.439479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac48b68fdd0416182ae57aa2f40a569'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.460560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac48b68fdd0416182ae57aa2f40a569'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:46.563062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 908/1852] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:46 2022] DELETE /identity/v3/users/7ac48b68fdd0416182ae57aa2f40a569 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:47.107762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:47.110857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:47.126601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e6a88-c647-4a75-b184-2cbd3a6fef75 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:47.197613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:47.198301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.200822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.200822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] PATH_INFO: `/v3/projects/83d635cb42834c8789ed4622c1f6643f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.200822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d635cb42834c8789ed4622c1f6643f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:47.202072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:47.354706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d635cb42834c8789ed4622c1f6643f', 'request_id': 'req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.372802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d635cb42834c8789ed4622c1f6643f', 'request_id': 'req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.454924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d635cb42834c8789ed4622c1f6643f', 'request_id': 'req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.466834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:47.468272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:47.472127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] The token cache is being invalidate because project 83d635cb42834c8789ed4622c1f6643f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:47.472423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.473390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-29b492e2-8543-457e-8ee0-bb4aaf3c1c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.475175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 945/1853] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:47 2022] DELETE /identity/v3/projects/83d635cb42834c8789ed4622c1f6643f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:47.480057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94a085-d788-49d4-b5ec-0e506e8f0453 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.480361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94a085-d788-49d4-b5ec-0e506e8f0453 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.481303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94a085-d788-49d4-b5ec-0e506e8f0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.482571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76107f8-97e7-4e70-a3fe-0017990f0b24 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:47.504069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4d94a085-d788-49d4-b5ec-0e506e8f0453 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:47.505347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d94a085-d788-49d4-b5ec-0e506e8f0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:47.546113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:47.594818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:47.596111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.596416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.596680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] PATH_INFO: `/v3/users/2817e164c7bf4c998c0b528d57a7343d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.607853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 946/1854] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:47.610227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2817e164c7bf4c998c0b528d57a7343d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:47.612545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.612877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.613158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.614750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:47.644350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:47.645584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:47.656331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 947/1855] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:47.660566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:47.670227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfafb6a-51ba-49a1-a1ec-25cabcbb0296 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:47.675811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:47.676434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.682988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.682988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.682988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:47.682988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:47.682988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:47.692962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 948/1856] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:38:47.697650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:47.710359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a749e62-3b08-41ee-a821-6a8e7831f1a8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:47.715553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:47.716926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.717226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.717507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.718307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:47.720229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:47.816961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 949/1857] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:47 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:47.825514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:47.836010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2817e164c7bf4c998c0b528d57a7343d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.836680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2817e164c7bf4c998c0b528d57a7343d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.837437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2817e164c7bf4c998c0b528d57a7343d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.856272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2817e164c7bf4c998c0b528d57a7343d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.878625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-946363ac-9e60-43f8-b3a3-48701226c37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2817e164c7bf4c998c0b528d57a7343d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:47.915699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81182f-787f-4810-bcfc-9b8b0e4720ed admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:47.920817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:47.922549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.926756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.926756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.926756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:47.929574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:47.980209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 909/1858] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:47 2022] DELETE /identity/v3/users/2817e164c7bf4c998c0b528d57a7343d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:47.985436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.985727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.986041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.005619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:48.006895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.054740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 950/1859] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:47 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:48.055714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.057460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.073020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9268-de6a-4da4-9ed9-efeae599e1f2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.080908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 910/1860] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:48.091992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.093670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.146677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.155108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.155577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.155871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.157477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.159884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.160715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b28ea2-5bb6-4dc3-a225-d5022af44248 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.164734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.165367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.165654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.165961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.172708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 951/1861] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:48.176915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.178348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.179987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.188605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa608ff-1acc-426c-a36a-305a17255083 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.192219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 911/1862] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:48.194687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0780ca-de0c-45dc-b19b-7928006fcee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.195306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0780ca-de0c-45dc-b19b-7928006fcee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.195586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0780ca-de0c-45dc-b19b-7928006fcee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.195879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0780ca-de0c-45dc-b19b-7928006fcee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.196525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0780ca-de0c-45dc-b19b-7928006fcee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.198167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0780ca-de0c-45dc-b19b-7928006fcee9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.214824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 952/1863] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:48.219154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.231728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9380a-4c50-41fc-9983-2ae12b759508 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.238539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.239461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.239808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.240098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] PATH_INFO: `/v3/projects/1dfd0c3def3946d2a0bd84ca35710378/users/e6c69340c24240fc866b49e22c919c54/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.259727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfd0c3def3946d2a0bd84ca35710378, user_id=e6c69340c24240fc866b49e22c919c54, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.263620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.372058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 912/1864] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:48 2022] PUT /identity/v3/projects/1dfd0c3def3946d2a0bd84ca35710378/users/e6c69340c24240fc866b49e22c919c54/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:48.383717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.384242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.384318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.438378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] MFA Rules not processed for user `e6c69340c24240fc866b49e22c919c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:48.440286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.514032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 953/1865] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:48.516173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.614005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3682-db9e-42c5-821e-2dd94497caf1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.633919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.634572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.634858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.635133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.638438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.640706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.761798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.764316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.768413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 913/1866] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:48 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:48.772054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.791947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85387dc9-c99c-4414-bb28-69d1ac943f29 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.795466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:48.908823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.910098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.910389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.910668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] PATH_INFO: `/v3/projects/1d74bdd601594e1fa595b4eb9bdbe4c5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.911942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d74bdd601594e1fa595b4eb9bdbe4c5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.912100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a450ad7-1e74-49b7-a714-b5b2fd5443cc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.918920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.919935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.920807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.921100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.921377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.922062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.924804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.039243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 914/1867] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:48 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:49.044567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:49.056696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a981071-dcd4-4830-b091-475286e4d2f8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:49.062946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:49.063513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.063873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.064211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.065101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:49.069962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.080341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 915/1868] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:49.084602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:49.088997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d74bdd601594e1fa595b4eb9bdbe4c5', 'request_id': 'req-c3a5b49f-fb6d-459b-bf89-27dac260dfca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.095397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076e67-6095-4493-b822-d947f7127a71 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:49.098697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d74bdd601594e1fa595b4eb9bdbe4c5', 'request_id': 'req-c3a5b49f-fb6d-459b-bf89-27dac260dfca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.163203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:49.163883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.164170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.164452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] PATH_INFO: `/v3/projects/b07cbfdcb1ce49878a7dea1906eb2b50/users/a9ed7893186347e585d7f43e84c408f2/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.183007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07cbfdcb1ce49878a7dea1906eb2b50, user_id=a9ed7893186347e585d7f43e84c408f2, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:49.186563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.196677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d74bdd601594e1fa595b4eb9bdbe4c5', 'request_id': 'req-c3a5b49f-fb6d-459b-bf89-27dac260dfca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.216716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] The token cache is being invalidate because project 1d74bdd601594e1fa595b4eb9bdbe4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:49.217081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.217898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.219456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 954/1869] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:48 2022] DELETE /identity/v3/projects/1d74bdd601594e1fa595b4eb9bdbe4c5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:49.223373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:49.224775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:49.237742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b49f-fb6d-459b-bf89-27dac260dfca admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:49.246521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:49.248232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.248591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.248943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] PATH_INFO: `/v3/users/0d5e7be31f254d98951779d02f593f6a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.250784 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5e7be31f254d98951779d02f593f6a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:49.256429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.311784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 916/1870] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:49 2022] PUT /identity/v3/projects/b07cbfdcb1ce49878a7dea1906eb2b50/users/a9ed7893186347e585d7f43e84c408f2/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:49.315464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:49.317110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:49.410216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9772a-fc32-4749-b86f-b89e658cbce4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:49.415926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:49.416572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.416873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.417138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.418405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:49.420121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.430454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 917/1871] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:49.435150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:49.445346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3fe3b-8fa5-448b-99a1-5ef752138711 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:49.451967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b33361-6296-4050-945b-e442387bb90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:49.452639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33361-6296-4050-945b-e442387bb90b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.452927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33361-6296-4050-945b-e442387bb90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.453205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33361-6296-4050-945b-e442387bb90b admin admin] PATH_INFO: `/v3/projects/b07cbfdcb1ce49878a7dea1906eb2b50/users/a9ed7893186347e585d7f43e84c408f2/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.455160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b33361-6296-4050-945b-e442387bb90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07cbfdcb1ce49878a7dea1906eb2b50, user_id=a9ed7893186347e585d7f43e84c408f2, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:49.457812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b33361-6296-4050-945b-e442387bb90b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.469418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 918/1872] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:49 2022] PUT /identity/v3/projects/b07cbfdcb1ce49878a7dea1906eb2b50/users/a9ed7893186347e585d7f43e84c408f2/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:49.475231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5e7be31f254d98951779d02f593f6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.480516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.480869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.481151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.488849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:49.530400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5e7be31f254d98951779d02f593f6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.532148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5e7be31f254d98951779d02f593f6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.554563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] MFA Rules not processed for user `a9ed7893186347e585d7f43e84c408f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:49.556588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:49.558934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5e7be31f254d98951779d02f593f6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.559789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5e7be31f254d98951779d02f593f6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:49.581932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 955/1873] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:49 2022] DELETE /identity/v3/users/0d5e7be31f254d98951779d02f593f6a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:49.671563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 919/1874] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:49.680017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:49.682101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:49.780960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230db92d-5e56-4c93-8a4f-00d8ba6622d8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:49.790379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:49.791528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:49.791972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:49.792244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:49.794794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:49.883440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:49.885211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:49.898988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 956/1875] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:50.345934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:50.347571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:50.385724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:50.387944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:50.432131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:50.464355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020510b-00c0-4bca-af2e-ef56f8551baa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:50.489773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4292c-4afb-473d-b9c7-f6f8bd390f06 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:50.496706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:50.496706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:50.497096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:50.497474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] PATH_INFO: `/v3/projects/b9ba860dbcbc48848d60918e3b0d1088` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:50.498849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ba860dbcbc48848d60918e3b0d1088)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:50.503347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:50.548899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:50.549730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:50.550166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:50.550550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] PATH_INFO: `/v3/users/3278d59df25c4fdda9092de62cc7dc80` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:50.551893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3278d59df25c4fdda9092de62cc7dc80)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:50.554130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:50.720428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ba860dbcbc48848d60918e3b0d1088', 'request_id': 'req-713560a5-363e-4465-b1d0-d52edeed3cfa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.737317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ba860dbcbc48848d60918e3b0d1088', 'request_id': 'req-713560a5-363e-4465-b1d0-d52edeed3cfa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.838596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ba860dbcbc48848d60918e3b0d1088', 'request_id': 'req-713560a5-363e-4465-b1d0-d52edeed3cfa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.840075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:50.854480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3278d59df25c4fdda9092de62cc7dc80'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.855772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3278d59df25c4fdda9092de62cc7dc80'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.856621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3278d59df25c4fdda9092de62cc7dc80'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.864665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3278d59df25c4fdda9092de62cc7dc80'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.867404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] The token cache is being invalidate because project b9ba860dbcbc48848d60918e3b0d1088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:50.868516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.871311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.878518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 957/1876] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:50 2022] DELETE /identity/v3/projects/b9ba860dbcbc48848d60918e3b0d1088 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:50.882336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:50.889928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-64274ca1-5577-4d23-832f-16b0b941bbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3278d59df25c4fdda9092de62cc7dc80'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:50.890786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:50.961979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 920/1877] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:50 2022] DELETE /identity/v3/users/3278d59df25c4fdda9092de62cc7dc80 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:50.973027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ab7a-1667-4826-9b4b-317e627a6588 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:50.973027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ab7a-1667-4826-9b4b-317e627a6588 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:50.973027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04ab7a-1667-4826-9b4b-317e627a6588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:50.990021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d04ab7a-1667-4826-9b4b-317e627a6588 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:50.991448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d04ab7a-1667-4826-9b4b-317e627a6588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.036422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713560a5-363e-4465-b1d0-d52edeed3cfa admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.110274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 921/1878] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:51.118193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc506-505f-4400-97e4-2818184544ee None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.118854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.120344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc506-505f-4400-97e4-2818184544ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.121260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.121782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffc506-505f-4400-97e4-2818184544ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.123469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.123868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.129526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.185960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d5ffc506-505f-4400-97e4-2818184544ee None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:51.188362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d5ffc506-505f-4400-97e4-2818184544ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.204749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 922/1879] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:51.206478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.208694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.209303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.260497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:51.262853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.266720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.268673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.284175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 923/1880] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:51.288413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.291657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 958/1881] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:51.293971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.303406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.310547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f2a7f-647a-4489-b240-b913f1950e3a service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.316478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.317361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.317969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.318641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.319543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:51.320208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.322223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.342554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 959/1882] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:38:51.350355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.365648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04693-a9f0-41af-ab24-d6ea6d5ecb79 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.375260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.378537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.380334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.381447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.384139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.393090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.439340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1ebb-fd4f-4f4d-96a5-3a2bb4afbfdb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.445672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.446610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.446968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.447378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.467276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.469099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.482053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 924/1883] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:51.591751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 960/1884] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:51 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:51.593030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.610835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b55f8-394a-4491-87cd-a8e578628a20 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.683005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.683915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.684203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.684495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.685456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.690947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.816211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.825850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 925/1885] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:51 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:51.830403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4741-4147-4a89-ae05-e4f242594f2f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.861367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.861367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.861367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.861367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.870228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.870228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.912405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 961/1886] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:51.913646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.928867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118d94e-d2d3-45f9-a481-21f3f5783381 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.944293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b52a-75fc-4181-bf1e-4076e4876667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.944565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b52a-75fc-4181-bf1e-4076e4876667 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.944868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b52a-75fc-4181-bf1e-4076e4876667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.945143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b52a-75fc-4181-bf1e-4076e4876667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.945806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b52a-75fc-4181-bf1e-4076e4876667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.947428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b52a-75fc-4181-bf1e-4076e4876667 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.962280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 926/1887] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:51.972156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.986315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afedb3-c162-4b50-ae39-8b5b7958f688 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.993569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.994866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.995147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.995500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] PATH_INFO: `/v3/projects/9952368560e5484ba07fd64d748b6367/users/498479bfb0bd4d9a990a7cea60e08dba/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.014913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9952368560e5484ba07fd64d748b6367, user_id=498479bfb0bd4d9a990a7cea60e08dba, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:52.017868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:52.134428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 962/1888] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:51 2022] PUT /identity/v3/projects/9952368560e5484ba07fd64d748b6367/users/498479bfb0bd4d9a990a7cea60e08dba/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:52.146968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:52.147255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:52.147531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.179152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] MFA Rules not processed for user `498479bfb0bd4d9a990a7cea60e08dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:52.180444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:52.276974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:52.329901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 927/1889] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:52.336971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:52.368196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:52.392942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee78a89-a8e5-421c-8f0c-df7601e29009 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:52.397272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:52.401013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:52.401013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:52.401013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.401985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:52.457371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9709ca8-8e11-4cc6-9f9b-f58d3ec1efb6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:52.463581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:52.464247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:52.464703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:52.469998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.469998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:52.469998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:52.487318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:52.489614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:52.503869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 963/1890] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:52.543322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:52.545480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:52.573207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a216601-1a04-4329-9f42-23ed3a121ea0 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:52.578766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:52.579406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:52.579690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:52.580017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] PATH_INFO: `/v3/projects/f3e1dc39056e45ae91bc881136f95393` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.581554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e1dc39056e45ae91bc881136f95393)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:52.594862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:52.630295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 928/1891] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:52 2022] POST /identity/v3/projects => generated 383 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:52.631553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:52.753535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e1dc39056e45ae91bc881136f95393', 'request_id': 'req-6caaef21-859a-457e-bf58-f54a0e2ce089'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:52.754576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469df35d-0af5-4c86-99f2-f0ec1f16d9de admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:52.769017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e1dc39056e45ae91bc881136f95393', 'request_id': 'req-6caaef21-859a-457e-bf58-f54a0e2ce089'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:52.858130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:52.858883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:52.859249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:52.859473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.860116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:52.862060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:52.865456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e1dc39056e45ae91bc881136f95393', 'request_id': 'req-6caaef21-859a-457e-bf58-f54a0e2ce089'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:52.881092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] The token cache is being invalidate because project f3e1dc39056e45ae91bc881136f95393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:52.881506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:52.882275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:52.888670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 964/1892] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:52 2022] DELETE /identity/v3/projects/f3e1dc39056e45ae91bc881136f95393 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:52.890069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:52.892357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:52.905506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaef21-859a-457e-bf58-f54a0e2ce089 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:52.910465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:52.911111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:52.911396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:52.911669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] PATH_INFO: `/v3/users/47bb173af68146109991a3c14eec556c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:52.912919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bb173af68146109991a3c14eec556c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:52.914938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:52.974613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:52.981225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 929/1893] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:52 2022] POST /identity/v3/users => generated 298 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:52.982384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:52.984171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:52.998170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaaab4-5179-4473-9d3a-c276849416e9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:53.005453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:53.006221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.006598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.006939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.007659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:53.009455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:53.021907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 930/1894] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:53.025313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:53.038215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8fa5a-88e9-467a-a48c-2bc02e6de617 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:53.043954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:53.044827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.045210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.045594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] PATH_INFO: `/v3/projects/60651dfee64149ca9813b405d154fa5f/users/39a442d4c40941b2a020eb90a95d1fd0/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.065289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60651dfee64149ca9813b405d154fa5f, user_id=39a442d4c40941b2a020eb90a95d1fd0, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:53.068900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:53.191883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 931/1895] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:53 2022] PUT /identity/v3/projects/60651dfee64149ca9813b405d154fa5f/users/39a442d4c40941b2a020eb90a95d1fd0/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:53.196553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:53.202818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bb173af68146109991a3c14eec556c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:53.278459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf5808-2603-4421-a60f-c8a2edd06913 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:53.282656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bb173af68146109991a3c14eec556c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:53.283502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bb173af68146109991a3c14eec556c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:53.284000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:53.286711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.286711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.286711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.286711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:53.288308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:53.298890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bb173af68146109991a3c14eec556c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:53.299913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b856301f-a138-4bc8-aa1b-725f2b23ac3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bb173af68146109991a3c14eec556c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:53.300104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 932/1896] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:53.304583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:53.306326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:53.316049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 965/1897] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:52 2022] DELETE /identity/v3/users/47bb173af68146109991a3c14eec556c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:53.320502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa503387-d21b-44b1-b20c-9ebd5e8f9bd9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:53.400715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:53.401488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.402123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.404154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] PATH_INFO: `/v3/projects/60651dfee64149ca9813b405d154fa5f/users/39a442d4c40941b2a020eb90a95d1fd0/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.404666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60651dfee64149ca9813b405d154fa5f, user_id=39a442d4c40941b2a020eb90a95d1fd0, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:53.407548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:53.419109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 933/1898] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:53 2022] PUT /identity/v3/projects/60651dfee64149ca9813b405d154fa5f/users/39a442d4c40941b2a020eb90a95d1fd0/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:53.432916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.432916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.432916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.464419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] MFA Rules not processed for user `39a442d4c40941b2a020eb90a95d1fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:53.465896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:53.550661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 966/1899] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:53.565066 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:53.567678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:53.644950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce983cd-a965-4634-90f5-646a38d5b439 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:53.649106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:53.649730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.650043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.650318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.662826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:53.663809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:53.677161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 934/1900] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:53.800161 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:53.809396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfccf83-4df7-4cea-b459-bacab54982b9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:53.814038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:53.814656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.814936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.815209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.821897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:53.903678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:53.905122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e91e93-0500-4cc7-91fa-6b1827a9e176 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:53.914642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 967/1901] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:53.966896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:53.968631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:54.066903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4a269-0405-4962-b2f1-4c5b78310df9 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.071686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.072324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.078598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.078598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] PATH_INFO: `/v3/projects/ff75ed935d824ca686739d9cac5bc31e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.078598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff75ed935d824ca686739d9cac5bc31e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.078598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.192145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff75ed935d824ca686739d9cac5bc31e', 'request_id': 'req-f7d4a828-6082-4122-bf99-bd100530d80b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:54.199235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff75ed935d824ca686739d9cac5bc31e', 'request_id': 'req-f7d4a828-6082-4122-bf99-bd100530d80b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:54.340115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff75ed935d824ca686739d9cac5bc31e', 'request_id': 'req-f7d4a828-6082-4122-bf99-bd100530d80b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:54.355753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] The token cache is being invalidate because project ff75ed935d824ca686739d9cac5bc31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:54.356057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:54.356778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f7d4a828-6082-4122-bf99-bd100530d80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:54.358341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 935/1902] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:53 2022] DELETE /identity/v3/projects/ff75ed935d824ca686739d9cac5bc31e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:54.363559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.368027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.368027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.384446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:54.385680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:54.460091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 968/1903] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:54.471047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.471341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.471626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.491674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:54.492890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:54.501842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 936/1904] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:54.506228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.516146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ba0f-e2e3-46b0-b27b-967b95265bff None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.520715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.521317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.521595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.521883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.522543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:38:54.522844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.524450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.536349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 969/1905] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:38:54.541448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.551480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:54.553653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54319037-0ad3-495e-bc77-4434c9475244 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.565896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.565896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.565896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.565896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.566955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.566955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.689395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 937/1906] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:54 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:54.693834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.704921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10ff9c-3244-4ab2-980b-04b4a669afcb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.767449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.768070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.768354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.768630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.769252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.771235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.859265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 970/1907] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:54 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:54.863365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.875403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d2950-d76d-49bb-b17e-4e54bab63dc1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.880562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.881171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.881451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.881742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.882399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.884048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.896210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 938/1908] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:54.900294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.911438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b72b6-bd1c-418f-b31a-be07bf20e777 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.917401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ef26c-e0bb-4cbf-b930-9de15d85d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.918542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ef26c-e0bb-4cbf-b930-9de15d85d5df admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.918825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ef26c-e0bb-4cbf-b930-9de15d85d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.919164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ef26c-e0bb-4cbf-b930-9de15d85d5df admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.919755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ef26c-e0bb-4cbf-b930-9de15d85d5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.921345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ef26c-e0bb-4cbf-b930-9de15d85d5df admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.934831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 971/1909] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:54.939374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.951575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2322b1-26ac-4273-84e0-76b6984febf4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.957893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.962828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.962828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.962828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] PATH_INFO: `/v3/projects/0dde00dea33944a58a3cfd1c32d15df3/users/b367070a6bc34e60a300a9f4ca5e34e4/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.976471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dde00dea33944a58a3cfd1c32d15df3, user_id=b367070a6bc34e60a300a9f4ca5e34e4, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.979462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.998086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:55.123381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 939/1910] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:54 2022] PUT /identity/v3/projects/0dde00dea33944a58a3cfd1c32d15df3/users/b367070a6bc34e60a300a9f4ca5e34e4/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:55.133481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.133820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.134075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.163590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] MFA Rules not processed for user `b367070a6bc34e60a300a9f4ca5e34e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:55.164799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:55.236610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 972/1911] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:55.242902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:55.335197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168aa933-fa7b-4e94-bcb3-54a52f32fee5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:55.344229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:55.344229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.344229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.345428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.345428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:55.348535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:55.494382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 940/1912] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:38:55 2022] POST /identity/v3/projects => generated 363 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:38:55.496133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:55.506837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dbe8e-b628-49d2-aeab-b17090fbd676 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:55.573174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:55.574972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.575407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.575873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.577609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:55.581583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:55.702317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 973/1913] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:38:55 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:38:55.706573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:55.719961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebda53-8308-4a11-a5aa-74247cd03cf6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:55.734320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:55.734958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.735242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.735519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.736192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:55.737798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:55.753136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 941/1914] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:38:55.758092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:55.775655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ca228-726f-4f64-b997-7df2cb0ecc9a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:55.787275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:55.791919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.791919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.791919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] PATH_INFO: `/v3/projects/c49b40f4462a4d9aa9611fb12c0ce15b/users/2cc386adc5e54c4fae0e223558a82192/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.811610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49b40f4462a4d9aa9611fb12c0ce15b, user_id=2cc386adc5e54c4fae0e223558a82192, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:55.814789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:55.880462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 974/1915] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:55 2022] PUT /identity/v3/projects/c49b40f4462a4d9aa9611fb12c0ce15b/users/2cc386adc5e54c4fae0e223558a82192/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:55.885009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:55.895685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873d31-1edd-4a7b-8dfb-42c13c719a1b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:55.960221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c384a24-d3e7-4290-8417-77b676ffc8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:55.960889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c384a24-d3e7-4290-8417-77b676ffc8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.961176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c384a24-d3e7-4290-8417-77b676ffc8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.961596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c384a24-d3e7-4290-8417-77b676ffc8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.962385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c384a24-d3e7-4290-8417-77b676ffc8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:55.964118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c384a24-d3e7-4290-8417-77b676ffc8ad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:55.974065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:55.979259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 942/1916] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:38:55.979405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:55.989615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407520-d146-46fd-95a1-0f1ce71276ab admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:55.994436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:55.995336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:55.995735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:55.996006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] PATH_INFO: `/v3/projects/c49b40f4462a4d9aa9611fb12c0ce15b/users/2cc386adc5e54c4fae0e223558a82192/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:55.998288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49b40f4462a4d9aa9611fb12c0ce15b, user_id=2cc386adc5e54c4fae0e223558a82192, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:56.001002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:56.015510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 975/1917] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:38:55 2022] PUT /identity/v3/projects/c49b40f4462a4d9aa9611fb12c0ce15b/users/2cc386adc5e54c4fae0e223558a82192/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:56.028791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:56.029079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:56.029393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:56.061232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] MFA Rules not processed for user `2cc386adc5e54c4fae0e223558a82192`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:56.067480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:56.158216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 943/1918] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:56.175696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:56.177425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:56.244652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7493c-2cab-49a0-b1ce-d8f3ffec9e71 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:56.248751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:56.249405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:56.249685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:56.249992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:56.260666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:56.262814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:56.278586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 976/1919] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:56.509204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:56.511419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:56.524603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815d38e-9628-4e11-bb24-43136b38fbdd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:56.531547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebcfbd-0cef-4108-ab8f-5d9068224be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:56.535553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebcfbd-0cef-4108-ab8f-5d9068224be3 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:56.535553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebcfbd-0cef-4108-ab8f-5d9068224be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:56.535553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebcfbd-0cef-4108-ab8f-5d9068224be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:56.614782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebcfbd-0cef-4108-ab8f-5d9068224be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:56.617061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebcfbd-0cef-4108-ab8f-5d9068224be3 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:56.628804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 944/1920] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:57.266810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:57.321123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:57.324760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:57.400353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac30a2-d9ab-404c-88f2-5b5aa57ff8fb service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:57.412291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:57.413236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:57.413520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:57.413795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] PATH_INFO: `/v3/users/e6c69340c24240fc866b49e22c919c54` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:57.415117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c69340c24240fc866b49e22c919c54)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:57.417042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:57.556152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:57.642978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c69340c24240fc866b49e22c919c54'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:57.700071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c69340c24240fc866b49e22c919c54'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:57.700658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c69340c24240fc866b49e22c919c54'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:57.714636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c69340c24240fc866b49e22c919c54'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:57.715499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c69340c24240fc866b49e22c919c54'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:57.730075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 977/1921] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:57 2022] DELETE /identity/v3/users/e6c69340c24240fc866b49e22c919c54 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:57.734601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:57.734890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:57.735167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:57.754439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:57.755681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:57.817663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 945/1922] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:57.828609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:57.830969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:57.898674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f4a59-b0d7-497f-9281-d03b0510658f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:57.902819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:57.903444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:57.903724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:57.903996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:57.914700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:57.916180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:57.930243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 978/1923] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:58.428581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:58.429048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:58.445081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2c3a-0a96-4c36-b2c4-a827d0ef7b1a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:58.453349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:58.454723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:58.454723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:58.455068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] PATH_INFO: `/v3/projects/1dfd0c3def3946d2a0bd84ca35710378` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:58.456055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfd0c3def3946d2a0bd84ca35710378)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:58.464057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:58.519711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:58.521181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:58.535046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782541f-10e1-4b7d-8a47-577bf46e9550 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:58.539807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:58.540445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:58.540729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:58.542873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] PATH_INFO: `/v3/users/498479bfb0bd4d9a990a7cea60e08dba` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:58.542873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=498479bfb0bd4d9a990a7cea60e08dba)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:58.552322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:58.587098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfd0c3def3946d2a0bd84ca35710378', 'request_id': 'req-58320c9e-5ebd-4819-9c99-46c8bd9292ba'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.593821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfd0c3def3946d2a0bd84ca35710378', 'request_id': 'req-58320c9e-5ebd-4819-9c99-46c8bd9292ba'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.664756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfd0c3def3946d2a0bd84ca35710378', 'request_id': 'req-58320c9e-5ebd-4819-9c99-46c8bd9292ba'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.686730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] The token cache is being invalidate because project 1dfd0c3def3946d2a0bd84ca35710378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:58.686730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.687179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.688793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 946/1924] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:58 2022] DELETE /identity/v3/projects/1dfd0c3def3946d2a0bd84ca35710378 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:58.693215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:58.707735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:58.782868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498479bfb0bd4d9a990a7cea60e08dba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.792577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58320c9e-5ebd-4819-9c99-46c8bd9292ba admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:58.795912 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:58.796564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:58.796850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:58.797124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] PATH_INFO: `/v3/users/a9ed7893186347e585d7f43e84c408f2` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:58.798389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ed7893186347e585d7f43e84c408f2)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:58.800341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:58.855114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498479bfb0bd4d9a990a7cea60e08dba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.855114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498479bfb0bd4d9a990a7cea60e08dba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.860222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:58.871759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498479bfb0bd4d9a990a7cea60e08dba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.872702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0f6d9533-a11f-40ef-b377-42c9176fc170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498479bfb0bd4d9a990a7cea60e08dba'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:58.886654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 979/1925] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:58 2022] DELETE /identity/v3/users/498479bfb0bd4d9a990a7cea60e08dba => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:38:58.891252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:58.891611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:58.891901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:58.914644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:58.915094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:58.981030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 980/1926] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:58.992345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:58.993761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:59.033106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ed7893186347e585d7f43e84c408f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.033844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ed7893186347e585d7f43e84c408f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.034570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ed7893186347e585d7f43e84c408f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.042683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ed7893186347e585d7f43e84c408f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.058130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ed7893186347e585d7f43e84c408f2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.058316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca48e4-1905-4927-a0d7-4e01b33d83f2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:59.062766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:59.063399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:59.063742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:59.064015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:59.065910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:59.081956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:59.082757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:59.106108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 981/1927] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:59.134412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 947/1928] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:58 2022] DELETE /identity/v3/users/a9ed7893186347e585d7f43e84c408f2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:59.209037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:59.638998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:59.641345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:59.653289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db940a48-64f5-46e5-a9c6-feea76481fc6 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:59.706868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:59.708528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:59.725982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:59.726725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:59.727204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:59.727808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] PATH_INFO: `/v3/projects/9952368560e5484ba07fd64d748b6367` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:59.730246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9952368560e5484ba07fd64d748b6367)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:59.732903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:59.803080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014892-a735-4f3f-9d26-20c211aefe28 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:59.808736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:59.809576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:59.809907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:59.810215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] PATH_INFO: `/v3/projects/b07cbfdcb1ce49878a7dea1906eb2b50` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:59.811519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07cbfdcb1ce49878a7dea1906eb2b50)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:59.813470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:59.884055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9952368560e5484ba07fd64d748b6367', 'request_id': 'req-130b6137-68a2-4935-8c6b-3b8559f205f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.890736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9952368560e5484ba07fd64d748b6367', 'request_id': 'req-130b6137-68a2-4935-8c6b-3b8559f205f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.962416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07cbfdcb1ce49878a7dea1906eb2b50', 'request_id': 'req-0965075f-fe41-4e2b-be69-44c077c91ffe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.969746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07cbfdcb1ce49878a7dea1906eb2b50', 'request_id': 'req-0965075f-fe41-4e2b-be69-44c077c91ffe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.973142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9952368560e5484ba07fd64d748b6367', 'request_id': 'req-130b6137-68a2-4935-8c6b-3b8559f205f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.986543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] The token cache is being invalidate because project 9952368560e5484ba07fd64d748b6367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:38:59.986836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.987596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:38:59.989284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 982/1929] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:59 2022] DELETE /identity/v3/projects/9952368560e5484ba07fd64d748b6367 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:38:59.993279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:59.995336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:00.036150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07cbfdcb1ce49878a7dea1906eb2b50', 'request_id': 'req-0965075f-fe41-4e2b-be69-44c077c91ffe'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.050047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] The token cache is being invalidate because project b07cbfdcb1ce49878a7dea1906eb2b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:00.050543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.051303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0965075f-fe41-4e2b-be69-44c077c91ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.052773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 948/1930] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:38:59 2022] DELETE /identity/v3/projects/b07cbfdcb1ce49878a7dea1906eb2b50 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:00.062023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b5e1-8e34-4373-a237-8e930780a792 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.069820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b5e1-8e34-4373-a237-8e930780a792 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.069820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b5e1-8e34-4373-a237-8e930780a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.070287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6137-68a2-4935-8c6b-3b8559f205f3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.085479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9f40b5e1-8e34-4373-a237-8e930780a792 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:00.086794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9f40b5e1-8e34-4373-a237-8e930780a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:00.133212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.134829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.134829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.134829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] PATH_INFO: `/v3/users/39a442d4c40941b2a020eb90a95d1fd0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.135853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a442d4c40941b2a020eb90a95d1fd0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.137827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.159562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 949/1931] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:00.170407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.170737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.171034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.194500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:00.195397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:00.205104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 950/1932] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:00.209666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.223206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3cdd-c84f-46f0-ab6d-70cafa499561 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.230560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.231676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.232135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.232549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.233784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:00.234297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.237068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.251445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 951/1933] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:39:00.256399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.268030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba471db-08b7-439e-8850-0553fa58dfda admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.279490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.280186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.280474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.280754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.281610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.283718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.316765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a442d4c40941b2a020eb90a95d1fd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.382866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 952/1934] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:00 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:00.387679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.425014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a442d4c40941b2a020eb90a95d1fd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.426491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a442d4c40941b2a020eb90a95d1fd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.441734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a442d4c40941b2a020eb90a95d1fd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.442539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a442d4c40941b2a020eb90a95d1fd0'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:00.457976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 983/1935] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:38:59 2022] DELETE /identity/v3/users/39a442d4c40941b2a020eb90a95d1fd0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:00.464979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af06075-1bb9-4194-bbb7-f1e94359b3f8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.533314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.534064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.534409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.534747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.535481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.537547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.635937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.637618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:00.641547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 953/1936] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:00 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:00.647028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.648684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:00.653235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d0e65-ba94-4dd8-9a4d-7421c34fbf8e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.659666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.660556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.660985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.661408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] PATH_INFO: `/v3/users/b367070a6bc34e60a300a9f4ca5e34e4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.661796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd035-10a8-4dc4-aea4-b8c54f77cd07 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.662933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b367070a6bc34e60a300a9f4ca5e34e4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.665006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.667403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.668096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.668527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.669045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.669461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.671100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.683819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 954/1937] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:00.688343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.703509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c8944-cc64-4491-bdae-55745257c792 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.708518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.709152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.709394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.709695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.710442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.712033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.724846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 955/1938] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:00.728698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:00.739729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245304c4-4aa8-4889-a5da-db137db20557 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:00.746018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7695c65-e9c7-4f97-8712-564c5f524d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.747016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695c65-e9c7-4f97-8712-564c5f524d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.747309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695c65-e9c7-4f97-8712-564c5f524d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.747584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7695c65-e9c7-4f97-8712-564c5f524d50 admin admin] PATH_INFO: `/v3/projects/f2320a2db09048d78d9989cd7be2d954/users/c45b8d03d10b410fac7326ba90e75451/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.764720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7695c65-e9c7-4f97-8712-564c5f524d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2320a2db09048d78d9989cd7be2d954, user_id=c45b8d03d10b410fac7326ba90e75451, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.767598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7695c65-e9c7-4f97-8712-564c5f524d50 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.960745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:01.077054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 956/1939] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:00 2022] PUT /identity/v3/projects/f2320a2db09048d78d9989cd7be2d954/users/c45b8d03d10b410fac7326ba90e75451/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:01.147650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:01.148606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:01.149345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:01.183494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] MFA Rules not processed for user `c45b8d03d10b410fac7326ba90e75451`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:01.184885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:01.210805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b367070a6bc34e60a300a9f4ca5e34e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.254466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 957/1940] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:01.258888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:01.302997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b367070a6bc34e60a300a9f4ca5e34e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.302997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b367070a6bc34e60a300a9f4ca5e34e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.315801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b367070a6bc34e60a300a9f4ca5e34e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.316545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2af18261-bc8d-434e-a262-cb5cad01b0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b367070a6bc34e60a300a9f4ca5e34e4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.353302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a4f3-d278-4ac0-af11-517b16cac20f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:01.358092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 984/1941] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:00 2022] DELETE /identity/v3/users/b367070a6bc34e60a300a9f4ca5e34e4 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:01.364714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0da83-73a9-4e95-890a-df229391884b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:01.365016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0da83-73a9-4e95-890a-df229391884b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:01.365280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0da83-73a9-4e95-890a-df229391884b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:01.388797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-84b0da83-73a9-4e95-890a-df229391884b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:01.393269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-84b0da83-73a9-4e95-890a-df229391884b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:01.469179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:01.471312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:01.471312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:01.471312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:01.471312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:01.473104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:01.484827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 985/1942] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:01.500687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0da83-73a9-4e95-890a-df229391884b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:01.500687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-84b0da83-73a9-4e95-890a-df229391884b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:01.551722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:01.575849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0da83-73a9-4e95-890a-df229391884b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:01.583222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:01.586657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:01.586657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:01.586657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:01.618438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 958/1943] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:01 2022] POST /identity/v3/projects => generated 381 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:01.620865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:01.623343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:01.626255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:01.627694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:01.646597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 986/1944] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:01.647693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:01.649665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:01.670562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fac086-3fa8-4d64-ba18-c143c328aa97 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:01.741203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42de39-991e-41b6-a39f-85c9b0e89845 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:01.747504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:01.748211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:01.748497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:01.748778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] PATH_INFO: `/v3/projects/60651dfee64149ca9813b405d154fa5f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:01.750165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60651dfee64149ca9813b405d154fa5f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:01.755350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:01.755473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:01.755473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:01.755825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:01.755992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:01.756953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:01.759317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:01.785918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:01.877158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 987/1945] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:01 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:01.881110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:01.898893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60651dfee64149ca9813b405d154fa5f', 'request_id': 'req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.911668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60651dfee64149ca9813b405d154fa5f', 'request_id': 'req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:01.927056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8f304-cfdf-461b-b564-c7b65aff9e04 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.014271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60651dfee64149ca9813b405d154fa5f', 'request_id': 'req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.029289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.029976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.030260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.030537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.031258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.033483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.037617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] The token cache is being invalidate because project 60651dfee64149ca9813b405d154fa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:02.038023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.038886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc0cee0d-9d96-47b9-83b0-ceded34b9d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.044159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 959/1946] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:01 2022] DELETE /identity/v3/projects/60651dfee64149ca9813b405d154fa5f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:02.048572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751499b0-bcb3-4d7c-9546-91379b486849 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.050152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 988/1947] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:02.051129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751499b0-bcb3-4d7c-9546-91379b486849 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.053714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751499b0-bcb3-4d7c-9546-91379b486849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.054780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.059776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.082119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-751499b0-bcb3-4d7c-9546-91379b486849 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:02.083660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-751499b0-bcb3-4d7c-9546-91379b486849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.083813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cb05-8b3c-4c0a-8a57-5a0582ac0d24 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.093263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.094154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.094581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.094937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] PATH_INFO: `/v3/projects/07185730cd3847c5928ca1a1c89e74c4/users/071d70f296b84a539cb8d471d826c20a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.095795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 960/1948] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:02.105785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.107690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.107974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.130307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07185730cd3847c5928ca1a1c89e74c4, user_id=071d70f296b84a539cb8d471d826c20a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.132435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:02.133222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.133659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.142808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 961/1949] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:02.147884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.157449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d8066-6f0a-4f28-87c9-2b740c07112b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.162411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.163020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.163299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.163574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.164261 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:02.167226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.168850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.181972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 962/1950] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:39:02.187372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.197101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0741569-b26a-4461-86ad-ec3d90c0e4ed admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.205107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.205734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.206052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.206326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.207177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.208845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.230211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 989/1951] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:02 2022] PUT /identity/v3/projects/07185730cd3847c5928ca1a1c89e74c4/users/071d70f296b84a539cb8d471d826c20a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:02.234279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.298726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9ebd8-d0b0-4e05-8847-e3ff227c706c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.303598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.304213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.304495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.304766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.305439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.307863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.320602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 990/1952] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:02.325471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.326181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 963/1953] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:02 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:02.330609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.339675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1bd5c-52a8-4ac5-9008-b0feb67122a2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.416088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d44de4-c059-4c2d-bf76-5a877b71a78e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.422047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f408e2a-fe50-4d16-94f6-7501cc4f939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.422684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f408e2a-fe50-4d16-94f6-7501cc4f939f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.422970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f408e2a-fe50-4d16-94f6-7501cc4f939f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.423298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f408e2a-fe50-4d16-94f6-7501cc4f939f admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.423953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f408e2a-fe50-4d16-94f6-7501cc4f939f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.425910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f408e2a-fe50-4d16-94f6-7501cc4f939f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.431271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.433044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.433557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.434421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] PATH_INFO: `/v3/projects/07185730cd3847c5928ca1a1c89e74c4/users/071d70f296b84a539cb8d471d826c20a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.438074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07185730cd3847c5928ca1a1c89e74c4, user_id=071d70f296b84a539cb8d471d826c20a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.442797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.478037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 991/1954] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:02 2022] PUT /identity/v3/projects/07185730cd3847c5928ca1a1c89e74c4/users/071d70f296b84a539cb8d471d826c20a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:02.478037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.482635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.515092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 964/1955] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:02 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:02.520400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.520703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.520990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.576560 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] MFA Rules not processed for user `071d70f296b84a539cb8d471d826c20a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:02.579448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.581426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3626ed0-d0f1-4065-ae94-b5144cc5dbf0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.586756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.587776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.588101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.588555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] PATH_INFO: `/v3/projects/0dde00dea33944a58a3cfd1c32d15df3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.590401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dde00dea33944a58a3cfd1c32d15df3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.592393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.654852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:02.673959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 965/1956] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:02.675328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.694753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a706a8-d352-4fec-ab58-36f67e1d0cb7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.701427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.702655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.702655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.702655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.703354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.705071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:02.735339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 966/1957] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:02.737722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.742808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.746279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dde00dea33944a58a3cfd1c32d15df3', 'request_id': 'req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.769162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dde00dea33944a58a3cfd1c32d15df3', 'request_id': 'req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.837628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9cad-3a27-4b9b-96d0-47e2131dbdb5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.841700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dde00dea33944a58a3cfd1c32d15df3', 'request_id': 'req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.864375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] The token cache is being invalidate because project 0dde00dea33944a58a3cfd1c32d15df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:02.865833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.867836 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:02.875619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 992/1958] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:02 2022] DELETE /identity/v3/projects/0dde00dea33944a58a3cfd1c32d15df3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:02.881683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.881683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.934136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.936945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.937252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.937534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.940705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.992737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880a2b1-cda3-4e00-aae8-bd88543e3cb1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.994598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.995364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.995703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.995985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.996655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:02.998378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:03.013768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 993/1959] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:03.019274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:03.023747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:03.042490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178231b4-df19-49dc-9f83-590d081529ff admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:03.052282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:03.053782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:03.054274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:03.054786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] PATH_INFO: `/v3/users/2cc386adc5e54c4fae0e223558a82192` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:03.056972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc386adc5e54c4fae0e223558a82192)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:03.061317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:03.065473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:03.066965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:03.081010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 967/1960] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:03.102867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:03.117037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23face3b-f30c-45fb-84e1-5c4f13d6efe9 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:03.123295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fd844-a01e-4948-a2de-81220f150823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:03.124950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fd844-a01e-4948-a2de-81220f150823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:03.125275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fd844-a01e-4948-a2de-81220f150823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:03.126076 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fd844-a01e-4948-a2de-81220f150823 admin admin] PATH_INFO: `/v3/projects/be224176f5f14f73b43537aea33f760e/users/9d4463853d1f4fe89929cd109269a92e/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:03.144168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fd844-a01e-4948-a2de-81220f150823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be224176f5f14f73b43537aea33f760e, user_id=9d4463853d1f4fe89929cd109269a92e, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:03.146997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fd844-a01e-4948-a2de-81220f150823 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:03.278438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 968/1961] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:03 2022] PUT /identity/v3/projects/be224176f5f14f73b43537aea33f760e/users/9d4463853d1f4fe89929cd109269a92e/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:03.289067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:03.289364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:03.290221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:03.310742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc386adc5e54c4fae0e223558a82192'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:03.345713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] MFA Rules not processed for user `9d4463853d1f4fe89929cd109269a92e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:03.345713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:03.406952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc386adc5e54c4fae0e223558a82192'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:03.408108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc386adc5e54c4fae0e223558a82192'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:03.437675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:03.445952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc386adc5e54c4fae0e223558a82192'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:03.447281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc386adc5e54c4fae0e223558a82192'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:03.475419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 994/1962] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:03 2022] DELETE /identity/v3/users/2cc386adc5e54c4fae0e223558a82192 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:03.509741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 969/1963] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:03.523888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:03.534159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:03.604949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c6c88-3af2-434f-8028-4ccb21b37ef2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:03.610578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:03.611838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:03.612851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:03.612851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:03.760486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:03.760486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:03.774049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 995/1964] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:03.784986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:03.801228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:03.806685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:03.953723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:03.955472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:04.021174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9eb5-d835-45c2-a86b-b6ff2b6c8b62 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:04.067169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f683-918e-4477-a0f2-d9554deec23f service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:04.074243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:04.075523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.075523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.075718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] PATH_INFO: `/v3/users/c45b8d03d10b410fac7326ba90e75451` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:04.077138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45b8d03d10b410fac7326ba90e75451)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:04.078899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:04.099537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:04.100390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.100776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.101156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] PATH_INFO: `/v3/users/9d4463853d1f4fe89929cd109269a92e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:04.104547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4463853d1f4fe89929cd109269a92e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:04.106750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:04.321848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45b8d03d10b410fac7326ba90e75451'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.341668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4463853d1f4fe89929cd109269a92e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.342873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4463853d1f4fe89929cd109269a92e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.345915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4463853d1f4fe89929cd109269a92e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.357561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4463853d1f4fe89929cd109269a92e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.383473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-102fe608-49f2-45d4-9ea4-93a0ea9b8a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4463853d1f4fe89929cd109269a92e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.400451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45b8d03d10b410fac7326ba90e75451'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.401494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45b8d03d10b410fac7326ba90e75451'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.423502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45b8d03d10b410fac7326ba90e75451'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.424544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45b8d03d10b410fac7326ba90e75451'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.440947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 996/1965] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:03 2022] DELETE /identity/v3/users/c45b8d03d10b410fac7326ba90e75451 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:04.446216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:04.450165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:04.517151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 970/1966] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:03 2022] DELETE /identity/v3/users/9d4463853d1f4fe89929cd109269a92e => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:04.518529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdb178-3e1b-4e7b-88c0-533573722913 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.518904 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdb178-3e1b-4e7b-88c0-533573722913 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.519175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdb178-3e1b-4e7b-88c0-533573722913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:04.536797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81a97a-cefb-44c0-b426-af1d6bbabc82 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:04.541943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cfcdb178-3e1b-4e7b-88c0-533573722913 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:04.543520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cfcdb178-3e1b-4e7b-88c0-533573722913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:04.622613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 971/1967] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:04.624029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.624409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.624888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:04.652923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:04.654205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:04.656421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:04.670340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:04.670999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.671283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.671559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] PATH_INFO: `/v3/projects/c49b40f4462a4d9aa9611fb12c0ce15b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:04.673888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49b40f4462a4d9aa9611fb12c0ce15b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:04.675830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:04.678304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 972/1968] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:04.679491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:04.681334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:04.809844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461b91d-5bc6-4390-986d-da4e4b42d4ba None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:04.830945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49b40f4462a4d9aa9611fb12c0ce15b', 'request_id': 'req-048f7b96-7df7-48fd-9593-0d0df97b489b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.836950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49b40f4462a4d9aa9611fb12c0ce15b', 'request_id': 'req-048f7b96-7df7-48fd-9593-0d0df97b489b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.883530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613a53d-dd27-4380-9886-7b0d729e2e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:04.883530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a53d-dd27-4380-9886-7b0d729e2e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.883937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a53d-dd27-4380-9886-7b0d729e2e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.884479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613a53d-dd27-4380-9886-7b0d729e2e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:04.905351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49b40f4462a4d9aa9611fb12c0ce15b', 'request_id': 'req-048f7b96-7df7-48fd-9593-0d0df97b489b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.948197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] The token cache is being invalidate because project c49b40f4462a4d9aa9611fb12c0ce15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:04.948718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.949914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:04.952425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 997/1969] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:04 2022] DELETE /identity/v3/projects/c49b40f4462a4d9aa9611fb12c0ce15b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:04.959583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:04.962113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:04.976640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613a53d-dd27-4380-9886-7b0d729e2e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:04.978570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613a53d-dd27-4380-9886-7b0d729e2e33 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:04.987012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f7b96-7df7-48fd-9593-0d0df97b489b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:04.996415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:04.997698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:04.998901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:04.999549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.002955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.004960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 973/1970] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:05.007773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.008227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.010612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.046002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.046002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2eddc-b5eb-4ed4-8224-924e8dccabc9 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.051972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:05.055666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.067904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 998/1971] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:05.078516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 974/1972] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:05.086601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.086892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.087175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.115046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:05.116336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.135921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 999/1973] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:05.140743 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.155024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4261db-deda-4449-83ae-8e6fe617c608 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.169270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.169923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.170356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.170635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.171460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:05.172725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.174301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.198340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 975/1974] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:05.200620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.210808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bf4a1-d75e-4c48-95a7-40b03632b461 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.222053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.222053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.222053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.222053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.222639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.222639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.369596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1000/1975] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:05 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:05.375053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.390557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9a611-954c-4407-a698-507f5783f8a1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.589568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.590281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.594327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.594713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.595687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.602450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.699323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.702773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.725104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a664679-1b76-474c-a6d1-c1347673b540 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.725104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.725351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.725659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.725982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] PATH_INFO: `/v3/projects/be224176f5f14f73b43537aea33f760e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.727223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be224176f5f14f73b43537aea33f760e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.730494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.754259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 976/1976] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:05 2022] POST /identity/v3/users => generated 285 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:05.757631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.778722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969984e-a954-4f92-9bfd-fc718826f7c6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.778722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:05.782246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.783200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.783386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.783663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.784320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.785964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.798935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 977/1977] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:05.805128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.830137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2dfc8-c87d-4d08-81cd-d8129c4c44ff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.844487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b8a40-524f-4cbf-8018-3141c9e2ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.845364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b8a40-524f-4cbf-8018-3141c9e2ccb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.845771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b8a40-524f-4cbf-8018-3141c9e2ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.849415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b8a40-524f-4cbf-8018-3141c9e2ccb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.849415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b8a40-524f-4cbf-8018-3141c9e2ccb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.849415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b8a40-524f-4cbf-8018-3141c9e2ccb1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.862497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 978/1978] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:05.864027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c571ee-0446-44da-8fa9-8bcffda75abf None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.864972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c571ee-0446-44da-8fa9-8bcffda75abf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.865346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c571ee-0446-44da-8fa9-8bcffda75abf None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.867241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 979/1979] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:05.868063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c571ee-0446-44da-8fa9-8bcffda75abf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.886980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c571ee-0446-44da-8fa9-8bcffda75abf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.892294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce9f4-f2ae-4e3b-b341-a97d5c2388ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.893357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce9f4-f2ae-4e3b-b341-a97d5c2388ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.893637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce9f4-f2ae-4e3b-b341-a97d5c2388ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.896902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce9f4-f2ae-4e3b-b341-a97d5c2388ca admin admin] PATH_INFO: `/v3/projects/02e8c097540244d7a917ffcaf2245cf1/users/bca1a801d05448e39e0d8ad3ba3d9bca/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.912049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce9f4-f2ae-4e3b-b341-a97d5c2388ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e8c097540244d7a917ffcaf2245cf1, user_id=bca1a801d05448e39e0d8ad3ba3d9bca, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.914917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce9f4-f2ae-4e3b-b341-a97d5c2388ca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.922796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be224176f5f14f73b43537aea33f760e', 'request_id': 'req-454d869c-9089-4331-88cc-00054b50816e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:05.929841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be224176f5f14f73b43537aea33f760e', 'request_id': 'req-454d869c-9089-4331-88cc-00054b50816e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:05.996515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 980/1980] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:05 2022] PUT /identity/v3/projects/02e8c097540244d7a917ffcaf2245cf1/users/bca1a801d05448e39e0d8ad3ba3d9bca/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:05.997974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f66e4-2c32-4f17-83e2-8c6b798d33af None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.998268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f66e4-2c32-4f17-83e2-8c6b798d33af None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.998541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f66e4-2c32-4f17-83e2-8c6b798d33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.013268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be224176f5f14f73b43537aea33f760e', 'request_id': 'req-454d869c-9089-4331-88cc-00054b50816e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.021104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-732f66e4-2c32-4f17-83e2-8c6b798d33af None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:06.022556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-732f66e4-2c32-4f17-83e2-8c6b798d33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.033374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] The token cache is being invalidate because project be224176f5f14f73b43537aea33f760e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:06.034029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.035002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.037502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1001/1981] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:05 2022] DELETE /identity/v3/projects/be224176f5f14f73b43537aea33f760e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:06.038642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.040301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.099720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 981/1982] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:06.101251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbdbc-a25e-4437-ab74-cd1e6d983cfe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.101536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbdbc-a25e-4437-ab74-cd1e6d983cfe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.101815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbdbc-a25e-4437-ab74-cd1e6d983cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.132690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b60fbdbc-a25e-4437-ab74-cd1e6d983cfe None None] MFA Rules not processed for user `bca1a801d05448e39e0d8ad3ba3d9bca`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:06.134022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b60fbdbc-a25e-4437-ab74-cd1e6d983cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.143839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d869c-9089-4331-88cc-00054b50816e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.203284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 982/1983] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:06.204721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.205006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.205280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.224398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.224663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:06.225373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.225686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.225935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.226036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] PATH_INFO: `/v3/projects/f2320a2db09048d78d9989cd7be2d954` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.227071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2320a2db09048d78d9989cd7be2d954)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.229878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.235725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 983/1984] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:06.236553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.237790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.250328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1166-9264-470b-84eb-761a42c83e3c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.255708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.256341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.256623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.256903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] PATH_INFO: `/v3/users/92bb6d1386904f8a812c477860c65f9c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.258083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bb6d1386904f8a812c477860c65f9c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.260527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.361624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2320a2db09048d78d9989cd7be2d954', 'request_id': 'req-18e6048b-a0bc-4296-8b63-459a894d2d61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.368028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2320a2db09048d78d9989cd7be2d954', 'request_id': 'req-18e6048b-a0bc-4296-8b63-459a894d2d61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.430382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:06.447144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2320a2db09048d78d9989cd7be2d954', 'request_id': 'req-18e6048b-a0bc-4296-8b63-459a894d2d61'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.461595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bb6d1386904f8a812c477860c65f9c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.462324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bb6d1386904f8a812c477860c65f9c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.462951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bb6d1386904f8a812c477860c65f9c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.468482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] The token cache is being invalidate because project f2320a2db09048d78d9989cd7be2d954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:06.468773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.469445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.471076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1002/1985] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:06 2022] DELETE /identity/v3/projects/f2320a2db09048d78d9989cd7be2d954 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:06.471196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bb6d1386904f8a812c477860c65f9c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.471944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.473152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.484270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bb6d1386904f8a812c477860c65f9c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.544197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6048b-a0bc-4296-8b63-459a894d2d61 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.544816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 984/1986] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:06 2022] DELETE /identity/v3/users/92bb6d1386904f8a812c477860c65f9c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:06.545890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.550571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.622725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.623324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.623639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.623955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.625743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.628074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257553ba-9e22-4168-af2a-5c3657453376 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.634060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.636310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.637303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.637746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.638634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.638755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.640652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2ae10-c22e-4ced-ae00-01e1ba7af83d service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.641207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.652081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1003/1987] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:06.653097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.653399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.653677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.674808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:06.678401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.689968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1004/1988] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:06.689968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.689968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.701362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ed51c-35b1-45ab-840c-9b25432b7ca8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.706966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.708271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.708574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.708839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] PATH_INFO: `/v3/users/071d70f296b84a539cb8d471d826c20a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.710170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071d70f296b84a539cb8d471d826c20a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.712622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.745735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 985/1989] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:06 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:06.746896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.812178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d554a1-c55b-4028-8f5a-a174c5b6eeea admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.817168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.817781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.818091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.818367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.819026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:06.819329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.820943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.839061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 986/1990] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:06.839061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.839061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:06.850826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3b1f-815a-4cee-b535-1cdf33df2eff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.856212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.856874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.857280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.859596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.860539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.863217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.913603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071d70f296b84a539cb8d471d826c20a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.940600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 987/1991] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:06 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:06.941930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:06.956874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3555-49d0-45a2-8929-547f9d1a52c8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:06.961708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:06.962363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:06.962646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:06.962921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:06.963955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:06.966058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:06.996724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071d70f296b84a539cb8d471d826c20a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:06.997629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071d70f296b84a539cb8d471d826c20a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.011033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071d70f296b84a539cb8d471d826c20a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.012004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071d70f296b84a539cb8d471d826c20a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.025562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1005/1992] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:06 2022] DELETE /identity/v3/users/071d70f296b84a539cb8d471d826c20a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:07.027011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.028618 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.099145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 988/1993] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:06 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:07.099755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.101603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.128150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52eca8-111a-479a-baf8-2bced5cff552 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.188102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff5daf-e7b1-4029-9de7-43e3cd692f59 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.193687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.198839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.198839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.198839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.198839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.198839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.206761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.207410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.211152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 989/1994] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:07.211303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.211303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] PATH_INFO: `/v3/projects/3aa32153716e49dbaf271ddf93379ff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.211497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.211497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.211789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa32153716e49dbaf271ddf93379ff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.213802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.223544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc5fb-6dfd-40f4-9255-212779ffeaba admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.228434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.229768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.230085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.230391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.231057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.232944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.333556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 990/1995] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:07 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:07.333556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.345355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b306a6-3725-4486-b718-e0eb2bd66fcc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.347955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa32153716e49dbaf271ddf93379ff1', 'request_id': 'req-e95b1153-5465-467d-8f24-05e46003a0b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.356065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa32153716e49dbaf271ddf93379ff1', 'request_id': 'req-e95b1153-5465-467d-8f24-05e46003a0b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.409646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.410365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.410649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.410925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] PATH_INFO: `/v3/projects/f3a1d6c8f3ba4d4c9004fa7c9c1912b0/users/d77e6ac348ad44ddb8ee1fd38de861c5/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.423917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa32153716e49dbaf271ddf93379ff1', 'request_id': 'req-e95b1153-5465-467d-8f24-05e46003a0b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.427390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a1d6c8f3ba4d4c9004fa7c9c1912b0, user_id=d77e6ac348ad44ddb8ee1fd38de861c5, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.430135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.436657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] The token cache is being invalidate because project 3aa32153716e49dbaf271ddf93379ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:07.436976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.437645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.439219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1006/1996] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:07 2022] DELETE /identity/v3/projects/3aa32153716e49dbaf271ddf93379ff1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:07.440157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.441578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.451106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:07.458855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b1153-5465-467d-8f24-05e46003a0b5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.463954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e41fe-08b5-4c12-b020-78bab9c05b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.464360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e41fe-08b5-4c12-b020-78bab9c05b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.464639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e41fe-08b5-4c12-b020-78bab9c05b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.465314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e41fe-08b5-4c12-b020-78bab9c05b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.465723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e41fe-08b5-4c12-b020-78bab9c05b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.469695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e41fe-08b5-4c12-b020-78bab9c05b47 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.484352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1007/1997] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:07.485560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.485960 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.486238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.507996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:07.509284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.510456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 991/1998] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:07 2022] PUT /identity/v3/projects/f3a1d6c8f3ba4d4c9004fa7c9c1912b0/users/d77e6ac348ad44ddb8ee1fd38de861c5/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:07.511356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.512903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.572340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1008/1999] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:07.574781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.580519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023d37-1697-49f7-9946-7129b53dddcb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.585493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.586178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.586297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cafb4-3ea3-4507-99b5-93ae28141ae5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.586464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.590739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] PATH_INFO: `/v3/projects/07185730cd3847c5928ca1a1c89e74c4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.590739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07185730cd3847c5928ca1a1c89e74c4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.590739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.592889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.593715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.594166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.594586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.595280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.597030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.609339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1009/2000] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:07.610874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.615312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.629544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798c23-c989-4eb3-b44b-3306a5d5a88c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.634356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d97f6-65a8-41bd-829b-b6dbfa67669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.635660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d97f6-65a8-41bd-829b-b6dbfa67669f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.636284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d97f6-65a8-41bd-829b-b6dbfa67669f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.636562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d97f6-65a8-41bd-829b-b6dbfa67669f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.637226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d97f6-65a8-41bd-829b-b6dbfa67669f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.638860 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d97f6-65a8-41bd-829b-b6dbfa67669f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.649190 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1010/2001] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:07.650793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.651228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.651625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.671410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:07.672524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.681120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1011/2002] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:07.683158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.694089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6696f7d-1531-4ac4-b18c-8eef895b940e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.699038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07185730cd3847c5928ca1a1c89e74c4', 'request_id': 'req-b2aa2563-1892-4f7d-8b03-c3246ae4054d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.705750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07185730cd3847c5928ca1a1c89e74c4', 'request_id': 'req-b2aa2563-1892-4f7d-8b03-c3246ae4054d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.755608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63aea57-0314-4341-8847-d4c109e5106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.756275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aea57-0314-4341-8847-d4c109e5106d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.756560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aea57-0314-4341-8847-d4c109e5106d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.756842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aea57-0314-4341-8847-d4c109e5106d admin admin] PATH_INFO: `/v3/projects/f4cb05c5435b4feca560242cef13c3d3/users/ee278bac0d3c482ba89f9d5a2315681b/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.771387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63aea57-0314-4341-8847-d4c109e5106d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cb05c5435b4feca560242cef13c3d3, user_id=ee278bac0d3c482ba89f9d5a2315681b, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.774106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63aea57-0314-4341-8847-d4c109e5106d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.800874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07185730cd3847c5928ca1a1c89e74c4', 'request_id': 'req-b2aa2563-1892-4f7d-8b03-c3246ae4054d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.813642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] The token cache is being invalidate because project 07185730cd3847c5928ca1a1c89e74c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:07.813965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.814665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:07.816322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 992/2003] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:07 2022] DELETE /identity/v3/projects/07185730cd3847c5928ca1a1c89e74c4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:07.817073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.818659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.832148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa2563-1892-4f7d-8b03-c3246ae4054d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.839032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.839766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.840308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.840308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] PATH_INFO: `/v3/projects/f3a1d6c8f3ba4d4c9004fa7c9c1912b0/users/d77e6ac348ad44ddb8ee1fd38de861c5/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.842313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a1d6c8f3ba4d4c9004fa7c9c1912b0, user_id=d77e6ac348ad44ddb8ee1fd38de861c5, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.845071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:07.856895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 993/2004] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:07 2022] PUT /identity/v3/projects/f3a1d6c8f3ba4d4c9004fa7c9c1912b0/users/d77e6ac348ad44ddb8ee1fd38de861c5/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:07.862152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:07.862152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.887612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1012/2005] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:07 2022] PUT /identity/v3/projects/f4cb05c5435b4feca560242cef13c3d3/users/ee278bac0d3c482ba89f9d5a2315681b/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:07.890166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809751fc-5bbd-4532-8084-b3332c25f3f7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.890456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809751fc-5bbd-4532-8084-b3332c25f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.899513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809751fc-5bbd-4532-8084-b3332c25f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.919187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-809751fc-5bbd-4532-8084-b3332c25f3f7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:07.919187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-809751fc-5bbd-4532-8084-b3332c25f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:07.929838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397728c-7ba0-4b91-aa15-fe3c37685bbd admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:07.940709 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:07.992060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1013/2006] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:07.992522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:07.993145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.993597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebc0a-a629-443b-bb98-6c4fc654a504 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.993701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.994123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebc0a-a629-443b-bb98-6c4fc654a504 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.994277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.994939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebc0a-a629-443b-bb98-6c4fc654a504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.995448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:07.995869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:07.997481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54347-86e4-42a3-85de-acade2148a1e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.012044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 994/2007] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:08.013557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.013844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.014139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.028313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-71eebc0a-a629-443b-bb98-6c4fc654a504 None None] MFA Rules not processed for user `d77e6ac348ad44ddb8ee1fd38de861c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:08.031355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-71eebc0a-a629-443b-bb98-6c4fc654a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.048415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] MFA Rules not processed for user `ee278bac0d3c482ba89f9d5a2315681b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:08.049774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.076420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.122582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1014/2008] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:08.122582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.122582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.122582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.148706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 995/2009] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:08.149944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.154810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:08.156839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.164321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c75fd-b139-4893-9385-8c88b382f95c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.168605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1015/2010] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:08.169316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.170835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.172492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.177078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.177078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.177078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.177078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.177078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.188299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f6928-8838-4aca-acd2-78476cbd961a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.197211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.198247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.198358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.198569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] PATH_INFO: `/v3/users/b84aedc66e354a93acd48ee4969abc78` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.200024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84aedc66e354a93acd48ee4969abc78)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.202073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.261154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 996/2011] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:08.262133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.266300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.329767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68dcd8-fc8b-4579-8ffd-5bde9166518a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.333685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.334326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.334602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.334890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.362872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.396338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.401755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.402060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84aedc66e354a93acd48ee4969abc78'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:08.404267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.415020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 997/2012] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:08.415844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.417485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.428487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f350607-8c32-4090-8478-89bb765090ea service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.432832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.433615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.433920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.434198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.474220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84aedc66e354a93acd48ee4969abc78'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:08.475186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84aedc66e354a93acd48ee4969abc78'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:08.490733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84aedc66e354a93acd48ee4969abc78'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:08.491438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84aedc66e354a93acd48ee4969abc78'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:08.493790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.496271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.504702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1016/2013] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:08 2022] DELETE /identity/v3/users/b84aedc66e354a93acd48ee4969abc78 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:08.505549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.506146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 998/2014] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:08.507073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.507207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.594144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00503-55b0-43b4-b22e-3ae9a41300fe admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.599320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b8b9-012a-447b-9cc5-effc5ff803d5 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.600156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.600780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.601354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.601354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.602019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:08.602327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.604467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a0d0-d929-4654-bcee-c17398777328 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.606469 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.607152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.607439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.607722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.608394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.610551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.618358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1017/2015] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:08.621615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.621903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.622186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.642591 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:08.643798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.652220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1018/2016] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:08.652813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.668537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b3706-b156-4cce-88d4-aa2c4808a3ca None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.677272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.680701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.681111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.681460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.682646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.685659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.685659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.745131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 999/2017] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:08.746169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.747828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.806208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eda72-5167-4e77-a4da-077f0067f6c7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.809729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.814599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.815229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.815508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.815782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.817837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1019/2018] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/projects => generated 359 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:08.818844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.820527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.830823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.842067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.854667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1000/2019] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:08.858914 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.875300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3a89-d500-4b57-b015-56fca599b1ff service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.906308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71afab-273b-4e83-b69f-4f6b876927b4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.911552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.912192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.912804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.912804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.913476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.915388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.926112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1020/2020] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:08.930601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.940019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.941298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.942004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.942284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.942853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5b5e7-1af0-46ef-9edc-62fced8e934d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.948288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.948288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.950698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.951569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.951753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.952218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.953085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.955563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.969973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1021/2021] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:08.972553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.984014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533fc93-43db-4824-a2c7-80f05e4f4db2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.989447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8cc2-6373-4b82-9915-072c39b6172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.990288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8cc2-6373-4b82-9915-072c39b6172f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.990665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8cc2-6373-4b82-9915-072c39b6172f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.991027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8cc2-6373-4b82-9915-072c39b6172f admin admin] PATH_INFO: `/v3/projects/8018175a36514f2c85d3d4c1355c1b11/users/6c9d700c916c46c68dd9db5b8c37ffee/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.007999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8cc2-6373-4b82-9915-072c39b6172f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8018175a36514f2c85d3d4c1355c1b11, user_id=6c9d700c916c46c68dd9db5b8c37ffee, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.011451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e8cc2-6373-4b82-9915-072c39b6172f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.056332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1001/2022] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:08 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:09.057600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.067750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fec6b-3c75-4f6e-9870-05659acccabe admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.072528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.073258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.073492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.080329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.080329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.080329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.088532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1002/2023] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:09.091279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.101056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403e82d-601f-45e7-85dd-6744fbf85221 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.106809 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.107406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.107824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.108107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.108773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.110468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.121829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1003/2024] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:09.126247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.136000 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb297408-decd-4cf5-a2c1-d1d1b9de2941 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.140960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253783b9-4114-4e94-bb51-aa21da21ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.141897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253783b9-4114-4e94-bb51-aa21da21ebea admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.142173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253783b9-4114-4e94-bb51-aa21da21ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.142698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253783b9-4114-4e94-bb51-aa21da21ebea admin admin] PATH_INFO: `/v3/projects/a18806e01216433f9b58426609b7eba3/users/de6b74931d1247cfa90f203e28ab521e/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.158939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253783b9-4114-4e94-bb51-aa21da21ebea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18806e01216433f9b58426609b7eba3, user_id=de6b74931d1247cfa90f203e28ab521e, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.161737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253783b9-4114-4e94-bb51-aa21da21ebea admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.248124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1022/2025] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:08 2022] PUT /identity/v3/projects/8018175a36514f2c85d3d4c1355c1b11/users/6c9d700c916c46c68dd9db5b8c37ffee/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:09.258594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.258783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.259064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.294395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] MFA Rules not processed for user `6c9d700c916c46c68dd9db5b8c37ffee`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:09.295465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:09.296074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1004/2026] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:09 2022] PUT /identity/v3/projects/a18806e01216433f9b58426609b7eba3/users/de6b74931d1247cfa90f203e28ab521e/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:09.307689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.308051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.308327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.339626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] MFA Rules not processed for user `de6b74931d1247cfa90f203e28ab521e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:09.340872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:09.344428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:09.379052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:09.423856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1023/2027] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:09.428800 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.476055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1005/2028] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:09.531694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30368386-3e7a-4644-b590-6cdfe89c4409 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.531694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.531694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.531694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.532653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.532880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.535053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.540665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.543187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:09.645281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1024/2029] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:09 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:09.652802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.671125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb466b9-e90b-422e-b814-ce4894ecf24a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.686341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:09.758358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:09.799599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6c519-1890-48b9-bf7e-76e8cee45542 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.800263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.801208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.802233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.802550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.804501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.805126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.805396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.805671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.806330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.808507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.871820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.873382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.882954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1006/2030] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:09.883909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.887173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:09.912767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387cf97c-84e2-4b37-af70-8b1362f245b4 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.918306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.918956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.919243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.919522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] PATH_INFO: `/v3/projects/cb06b6efcbab48b0a90583a05b2a53b0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.920825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb06b6efcbab48b0a90583a05b2a53b0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.922831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:09.968381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1025/2031] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:09 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:09.969819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:09.982372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72317-6f2b-4f17-8228-392371df5cec admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:09.987741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:09.988385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:09.988672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:09.988947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] PATH_INFO: `/v3/users/de6b74931d1247cfa90f203e28ab521e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:09.991266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6b74931d1247cfa90f203e28ab521e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:09.992326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:10.092390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb06b6efcbab48b0a90583a05b2a53b0', 'request_id': 'req-9efc6f04-9b2a-451c-87a1-a927dd1a3722'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.098195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb06b6efcbab48b0a90583a05b2a53b0', 'request_id': 'req-9efc6f04-9b2a-451c-87a1-a927dd1a3722'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.222902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb06b6efcbab48b0a90583a05b2a53b0', 'request_id': 'req-9efc6f04-9b2a-451c-87a1-a927dd1a3722'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.235393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] The token cache is being invalidate because project cb06b6efcbab48b0a90583a05b2a53b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:10.235688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.236404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.237970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1007/2032] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:09 2022] DELETE /identity/v3/projects/cb06b6efcbab48b0a90583a05b2a53b0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:10.238770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:10.240283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.252576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:10.274126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6b74931d1247cfa90f203e28ab521e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.316745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc6f04-9b2a-451c-87a1-a927dd1a3722 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:10.322016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:10.323327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.323614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.323894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.324599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:10.326275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:10.340752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1008/2033] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:10.340752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:10.340752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.344507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:10.353870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065e4fb-153b-421f-8eb6-ddad8b1effc4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:10.358815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:10.359446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.359726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.360002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] PATH_INFO: `/v3/users/3fb89a3847ab40f588135c47f38be565` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.361125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb89a3847ab40f588135c47f38be565)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:10.363056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:10.383687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6b74931d1247cfa90f203e28ab521e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.384495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6b74931d1247cfa90f203e28ab521e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.398654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6b74931d1247cfa90f203e28ab521e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.399380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6b74931d1247cfa90f203e28ab521e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.411744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1026/2034] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:09 2022] DELETE /identity/v3/users/de6b74931d1247cfa90f203e28ab521e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:10.412730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:10.414105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.497479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c984-fb84-4db4-a69d-01c3a8c80b7f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:10.503119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658a578-93c1-487a-9827-1d5f0c3e4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:10.503930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a578-93c1-487a-9827-1d5f0c3e4515 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.504316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a578-93c1-487a-9827-1d5f0c3e4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.504760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a578-93c1-487a-9827-1d5f0c3e4515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.505895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a578-93c1-487a-9827-1d5f0c3e4515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:10.507508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a578-93c1-487a-9827-1d5f0c3e4515 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:10.519783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1027/2035] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:10.521198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.521438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.522174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.542036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:10.543274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.561940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1028/2036] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:10.562874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:10.585625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404066b-8f45-4339-bf5a-0c4354358e90 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:10.593122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5e792-2021-49fa-8be4-db50bbd40ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:10.594209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e792-2021-49fa-8be4-db50bbd40ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.596304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e792-2021-49fa-8be4-db50bbd40ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.596304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5e792-2021-49fa-8be4-db50bbd40ff9 admin admin] PATH_INFO: `/v3/projects/b33ce2dcb2e9480c9b60132cd59b8b0d/users/5e16523014d049ea9db79fc437399cdc/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.607650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb89a3847ab40f588135c47f38be565'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.608380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb89a3847ab40f588135c47f38be565'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.608988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb89a3847ab40f588135c47f38be565'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.624682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5e792-2021-49fa-8be4-db50bbd40ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33ce2dcb2e9480c9b60132cd59b8b0d, user_id=5e16523014d049ea9db79fc437399cdc, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:10.626157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb89a3847ab40f588135c47f38be565'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.630079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5e792-2021-49fa-8be4-db50bbd40ff9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:10.647547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb89a3847ab40f588135c47f38be565'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:10.721943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1009/2037] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:10 2022] DELETE /identity/v3/users/3fb89a3847ab40f588135c47f38be565 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:10.736103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1029/2038] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:10 2022] PUT /identity/v3/projects/b33ce2dcb2e9480c9b60132cd59b8b0d/users/5e16523014d049ea9db79fc437399cdc/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:10.738350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266404e-757c-4e16-9b28-50a2952ab7ed None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.738712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266404e-757c-4e16-9b28-50a2952ab7ed None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.739096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266404e-757c-4e16-9b28-50a2952ab7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.747310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:10.756643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.762298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a266404e-757c-4e16-9b28-50a2952ab7ed None None] MFA Rules not processed for user `ee278bac0d3c482ba89f9d5a2315681b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:10.763624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a266404e-757c-4e16-9b28-50a2952ab7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.836055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1030/2039] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:10.837706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.838249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.838768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.856989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d0f5a-d4a2-48bd-b984-6a803fba0a19 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:10.860903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:10.861722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.862277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.862657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.866212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.890440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] MFA Rules not processed for user `5e16523014d049ea9db79fc437399cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:10.891763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.929441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:10.987530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1031/2040] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:10.995232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:10.997469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:11.016730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.018551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.022868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e13de-aa16-4324-8155-82c07965ee3f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.033159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.034179 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.034634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.035057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.035844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.039926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1010/2041] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:11.043480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.071088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:11.181973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1032/2042] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:10 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:11.186246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.203082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d826f2-56d8-433c-9d02-1fae8bfbed1c service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.287230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.287660 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.288027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.288373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.289118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.291792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.439565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1011/2043] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:11 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:11.440742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.442720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:11.442822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.457156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b782c69-38e3-4189-88d4-a5c82058e747 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.459731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db423c0-e554-4361-92c5-ef35a4d932fc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.466105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.467090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.467090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.467683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.468341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.468454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.469077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.469357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.469634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] PATH_INFO: `/v3/projects/abdb2c412025435ea5130ee82d3b3360` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.470328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.470929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdb2c412025435ea5130ee82d3b3360)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.472726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.483769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1012/2044] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:11.488375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.502742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551dbd6-9059-4c10-a8cc-f3f841b27046 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.515523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:11.517988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.518731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.518940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.519178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] PATH_INFO: `/v3/projects/4ce84b6784694952a1defa2df5d19d4d/users/7d7e25256ded4642aa9966d5bb047d99/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.557601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce84b6784694952a1defa2df5d19d4d, user_id=7d7e25256ded4642aa9966d5bb047d99, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.570299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.676032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1013/2045] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:11 2022] PUT /identity/v3/projects/4ce84b6784694952a1defa2df5d19d4d/users/7d7e25256ded4642aa9966d5bb047d99/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:11.688174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.711950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdb2c412025435ea5130ee82d3b3360', 'request_id': 'req-3af6231f-5645-465e-9229-68099d93137d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:11.724263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdb2c412025435ea5130ee82d3b3360', 'request_id': 'req-3af6231f-5645-465e-9229-68099d93137d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:11.783129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5bc26-e8ea-476c-a1bd-36c67586acfc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.842576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdb2c412025435ea5130ee82d3b3360', 'request_id': 'req-3af6231f-5645-465e-9229-68099d93137d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:11.850740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.851375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.851664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.851970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.852780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.854534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.865193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] The token cache is being invalidate because project abdb2c412025435ea5130ee82d3b3360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:11.865564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:11.866510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:11.867273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1014/2046] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:11.870271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1033/2047] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:11 2022] DELETE /identity/v3/projects/abdb2c412025435ea5130ee82d3b3360 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:11.872128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.873186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.875270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:11.877319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:11.890143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6231f-5645-465e-9229-68099d93137d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.890656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc9524-db91-4481-8e15-ece2c9fb7206 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.895921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.907029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74102ce1-5ccd-4520-81e5-966f4607fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.907238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.907238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.907426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74102ce1-5ccd-4520-81e5-966f4607fc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.907512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] PATH_INFO: `/v3/projects/a18806e01216433f9b58426609b7eba3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.907614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74102ce1-5ccd-4520-81e5-966f4607fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.907614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74102ce1-5ccd-4520-81e5-966f4607fc51 admin admin] PATH_INFO: `/v3/projects/4ce84b6784694952a1defa2df5d19d4d/users/7d7e25256ded4642aa9966d5bb047d99/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.907854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18806e01216433f9b58426609b7eba3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.907949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74102ce1-5ccd-4520-81e5-966f4607fc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce84b6784694952a1defa2df5d19d4d, user_id=7d7e25256ded4642aa9966d5bb047d99, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.908060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.908159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74102ce1-5ccd-4520-81e5-966f4607fc51 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.925248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1034/2048] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:11 2022] PUT /identity/v3/projects/4ce84b6784694952a1defa2df5d19d4d/users/7d7e25256ded4642aa9966d5bb047d99/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:11.936308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884e1b-a737-40ac-a557-3aaff621a483 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.936308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884e1b-a737-40ac-a557-3aaff621a483 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.936308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884e1b-a737-40ac-a557-3aaff621a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.948547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3d884e1b-a737-40ac-a557-3aaff621a483 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:11.949744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3d884e1b-a737-40ac-a557-3aaff621a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.008911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1035/2049] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:12.010457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34379c-f288-4a61-8cd5-83229702a541 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.010745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34379c-f288-4a61-8cd5-83229702a541 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.011023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34379c-f288-4a61-8cd5-83229702a541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.044244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bb34379c-f288-4a61-8cd5-83229702a541 None None] MFA Rules not processed for user `7d7e25256ded4642aa9966d5bb047d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:12.045454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bb34379c-f288-4a61-8cd5-83229702a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.059210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18806e01216433f9b58426609b7eba3', 'request_id': 'req-7cb86d00-41dc-4ae9-9217-2cabb923a632'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.066803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18806e01216433f9b58426609b7eba3', 'request_id': 'req-7cb86d00-41dc-4ae9-9217-2cabb923a632'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.138776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1036/2050] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:12.140476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.140663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.140941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.160906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18806e01216433f9b58426609b7eba3', 'request_id': 'req-7cb86d00-41dc-4ae9-9217-2cabb923a632'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.162744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:12.163968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.175257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] The token cache is being invalidate because project a18806e01216433f9b58426609b7eba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:12.175703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.176971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.178650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1015/2051] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:11 2022] DELETE /identity/v3/projects/a18806e01216433f9b58426609b7eba3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:12.179688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.196654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.281333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:12.295856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1037/2052] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:12.296122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb86d00-41dc-4ae9-9217-2cabb923a632 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.303242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.304303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.304959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.305236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.305503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.313415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.319367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470dc7e-0cda-4c70-80f2-6a650fc082fc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.327188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.328118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.328535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.328941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.329718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:12.329975 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.330224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.331604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.332078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.345039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1016/2053] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:12.346973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1038/2054] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:39:12.351838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.367361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf740e07-a30b-4bfd-b8e7-73fcbc46e51c service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.374162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.374659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.374955 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.375221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.375862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.378129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.421880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.424513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.441873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5be12-be03-4907-a6fb-4d723c3a1b97 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.446503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.447737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.448234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.448561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] PATH_INFO: `/v3/users/bca1a801d05448e39e0d8ad3ba3d9bca` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.449951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca1a801d05448e39e0d8ad3ba3d9bca)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.451855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.510849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1017/2055] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:12 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:12.515229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.580972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e6638-cf10-4347-b8e5-692f77f96495 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.585619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.586265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.586547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.586821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.587444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.590030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.705085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1018/2056] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:12 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:12.709418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.721046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc5cc4-4b94-47ed-a4f3-bc1f33163050 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.725772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.726471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.726754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.727031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.728905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.730737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.741982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1019/2057] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:12.747246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.756399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4cba-a6b6-4d5d-92e2-6284f6f477ad admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.762720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.762720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.762720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.762720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.763099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.764507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.777521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1020/2058] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:12.781518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:12.788367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca1a801d05448e39e0d8ad3ba3d9bca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.792198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b6c1d-f91b-4283-aecb-1a57be3e4058 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:12.796794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac801ad-9223-418a-9751-e8c2311ce712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:12.797432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac801ad-9223-418a-9751-e8c2311ce712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.797711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac801ad-9223-418a-9751-e8c2311ce712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.798017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac801ad-9223-418a-9751-e8c2311ce712 admin admin] PATH_INFO: `/v3/projects/5076846587b547bab5a68bbb3cadda9c/users/a2de0290299647deb45fc5dfccb7fc55/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.816625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac801ad-9223-418a-9751-e8c2311ce712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5076846587b547bab5a68bbb3cadda9c, user_id=a2de0290299647deb45fc5dfccb7fc55, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:12.819336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac801ad-9223-418a-9751-e8c2311ce712 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:12.909596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca1a801d05448e39e0d8ad3ba3d9bca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.910236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca1a801d05448e39e0d8ad3ba3d9bca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.916314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1021/2059] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:12 2022] PUT /identity/v3/projects/5076846587b547bab5a68bbb3cadda9c/users/a2de0290299647deb45fc5dfccb7fc55/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:12.925751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca1a801d05448e39e0d8ad3ba3d9bca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.926547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-84c1c030-74ba-431e-8c41-5885d3d3a1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca1a801d05448e39e0d8ad3ba3d9bca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:12.926691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.926981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.927266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.940715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1039/2060] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:12 2022] DELETE /identity/v3/users/bca1a801d05448e39e0d8ad3ba3d9bca => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:12.945272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:12.945565 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:12.945874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:12.958728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] MFA Rules not processed for user `a2de0290299647deb45fc5dfccb7fc55`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:12.960030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:12.967138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:12.968365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:13.029629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1040/2061] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:13.030518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1022/2062] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:13.034877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.036311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:13.039575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.041207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:13.049807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b588e-025f-4313-8dba-91347ce160c5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.054442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.055045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.055326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.055598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.056343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.058437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.101026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e5aee-a4e0-4196-a0dd-7ff9c0931a25 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.104982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.105592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.105894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.106171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.115152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.116565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.126540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1023/2063] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:13.215312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1041/2064] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:13 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:13.219480 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.231388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabae544-eea9-4574-894f-373c65d145d5 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.291102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.291917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.292205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.292482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.293124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.295076 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.447596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1024/2065] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:13 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:13.448751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.459421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd859cb-4a4c-4da3-a7bb-04822306a24a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.464846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:13.466529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.467076 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.467355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.467628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.468281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.470524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.483778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1042/2066] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:13.487937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.499399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317942-4c80-4e0f-8125-aae0ad554957 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.504395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.505068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.505347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.505625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] PATH_INFO: `/v3/projects/d394ff8e8f4241a3be12ca627e39fc98/users/1a600b0b2af14c6aa292c660b806e910/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.521003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d394ff8e8f4241a3be12ca627e39fc98, user_id=1a600b0b2af14c6aa292c660b806e910, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.523667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.625438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.627230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:13.642038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894050f-3b08-41ac-9a58-92eacfc0a5f6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.649279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.649777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.650652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.650931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] PATH_INFO: `/v3/projects/02e8c097540244d7a917ffcaf2245cf1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.652560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e8c097540244d7a917ffcaf2245cf1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.654374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1025/2067] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:13 2022] PUT /identity/v3/projects/d394ff8e8f4241a3be12ca627e39fc98/users/1a600b0b2af14c6aa292c660b806e910/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:13.654509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.658355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.747903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41875e-c1ce-4895-8fae-cc301ef52537 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.753907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.754149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.754505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.754870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.755597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.757277 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.773578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1026/2068] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:13.778701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.788708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f32a5a-b73a-46c3-aaa6-6b40f98603ff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.789805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e8c097540244d7a917ffcaf2245cf1', 'request_id': 'req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:13.796414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e8c097540244d7a917ffcaf2245cf1', 'request_id': 'req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:13.867187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.868079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.873097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.873097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] PATH_INFO: `/v3/projects/d394ff8e8f4241a3be12ca627e39fc98/users/1a600b0b2af14c6aa292c660b806e910/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.873097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d394ff8e8f4241a3be12ca627e39fc98, user_id=1a600b0b2af14c6aa292c660b806e910, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:13.874964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:13.885908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1027/2069] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:13 2022] PUT /identity/v3/projects/d394ff8e8f4241a3be12ca627e39fc98/users/1a600b0b2af14c6aa292c660b806e910/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:13.886844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:13.888471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:13.896462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e8c097540244d7a917ffcaf2245cf1', 'request_id': 'req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:13.909184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] The token cache is being invalidate because project 02e8c097540244d7a917ffcaf2245cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:13.909475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:13.910194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4c6ff0df-1e2c-4c54-b410-7c211ead5e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:13.911981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1043/2070] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:13 2022] DELETE /identity/v3/projects/02e8c097540244d7a917ffcaf2245cf1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:13.912925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.913205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.915066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.946232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] MFA Rules not processed for user `1a600b0b2af14c6aa292c660b806e910`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:13.947822 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:13.954470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116851c8-3322-4b55-bb59-0d3f07eeef53 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:13.958232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:13.958866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:13.959200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:13.959471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:13.961307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:14.024108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1044/2071] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:14.024108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:14.024364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:14.024515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:14.025679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:14.034990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1028/2072] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:14.036241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:14.037833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:14.050053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90208b2-bbf4-4982-9737-248682d58f04 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:14.054016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:14.054626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:14.054907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:14.055176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:14.066352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:14.067859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:14.078696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1029/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:14.097043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d9e5c-ee6a-4e0a-be49-9bc356fd0c7b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:14.105747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:14.106432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:14.106722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:14.106982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] PATH_INFO: `/v3/users/d77e6ac348ad44ddb8ee1fd38de861c5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:14.108254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77e6ac348ad44ddb8ee1fd38de861c5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:14.110136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:14.297698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77e6ac348ad44ddb8ee1fd38de861c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:14.329537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:14.338620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426ffce-07d2-40df-80db-d798358f6dae service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:14.342248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:14.342844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:14.343130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:14.343389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:14.345125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:14.406327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:14.407762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:14.418303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1030/2074] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:14.440873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77e6ac348ad44ddb8ee1fd38de861c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:14.441657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77e6ac348ad44ddb8ee1fd38de861c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:14.463093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77e6ac348ad44ddb8ee1fd38de861c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:14.463964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-866f806b-f740-4651-8919-44325c2b6e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77e6ac348ad44ddb8ee1fd38de861c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:14.482260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1045/2075] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:14 2022] DELETE /identity/v3/users/d77e6ac348ad44ddb8ee1fd38de861c5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:14.576269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:15.132553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:15.146064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae37b9-accc-40e2-848c-6dd8c1cdfe08 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:15.205419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:15.206380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.206380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.206608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] PATH_INFO: `/v3/projects/f3a1d6c8f3ba4d4c9004fa7c9c1912b0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.207773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a1d6c8f3ba4d4c9004fa7c9c1912b0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:15.209776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:15.338321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a1d6c8f3ba4d4c9004fa7c9c1912b0', 'request_id': 'req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:15.354558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a1d6c8f3ba4d4c9004fa7c9c1912b0', 'request_id': 'req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:15.428137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a1d6c8f3ba4d4c9004fa7c9c1912b0', 'request_id': 'req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:15.441925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] The token cache is being invalidate because project f3a1d6c8f3ba4d4c9004fa7c9c1912b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:15.442372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:15.443033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e4484f6b-ae7b-4a95-8d32-d3a2246e6786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:15.448703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1031/2076] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:15 2022] DELETE /identity/v3/projects/f3a1d6c8f3ba4d4c9004fa7c9c1912b0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:15.450626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.450913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.451185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.483820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:15.483820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:15.551102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1046/2077] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:15.559418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.559797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.560147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.584303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:15.585757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:15.595311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1032/2078] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:15.596889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:15.599325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:15.609743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f3c8e-4972-4cb7-816a-269d784800c6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:15.615185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:15.615776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.616086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.616411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.617078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:15.617381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:15.620596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:15.637633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1047/2079] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:15.639085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:15.648570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677aaba-ebb0-4b7b-88c4-01bd2f75a0b4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:15.654118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:15.655521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.655521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.655521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.656223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:15.658232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:15.755888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1033/2080] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:15 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:15.757489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:15.768600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa930ca-8c02-43e2-8177-6f6d2c129145 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:15.837118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:15.839430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.839430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.839430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.839430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:15.842124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:15.918232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1048/2081] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:15 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:15.920751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:15.935404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11107f6-62f7-4803-a4ba-4a352407b0ae admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:15.941607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:15.942768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.943118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.943466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.946171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:15.947823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:15.960914 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1034/2082] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:15.966610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:15.980478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09956d0-ad46-48e6-bff7-f94251ee20bf admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:15.985776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a86b8e-7207-4b15-9094-c19f270dfbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:15.986563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86b8e-7207-4b15-9094-c19f270dfbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:15.986855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86b8e-7207-4b15-9094-c19f270dfbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:15.989000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a86b8e-7207-4b15-9094-c19f270dfbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:15.989754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86b8e-7207-4b15-9094-c19f270dfbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:15.991487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a86b8e-7207-4b15-9094-c19f270dfbd7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.004781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1049/2083] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:16.009012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.021592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601f323-216c-4644-ad3f-12dd06a1f092 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:16.029552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:16.031385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.032426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.033367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] PATH_INFO: `/v3/projects/1c4dc1a58fea4141804f179f1bdd1b25/users/62cf4f0510aa41dfac1452c8460b0688/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.058103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4dc1a58fea4141804f179f1bdd1b25, user_id=62cf4f0510aa41dfac1452c8460b0688, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:16.061444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.219335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1035/2084] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:16 2022] PUT /identity/v3/projects/1c4dc1a58fea4141804f179f1bdd1b25/users/62cf4f0510aa41dfac1452c8460b0688/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:16.231793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.232192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.232533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.263919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] MFA Rules not processed for user `62cf4f0510aa41dfac1452c8460b0688`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:16.265223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:16.329074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1050/2085] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:16.333888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.398471 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbbf63-dd31-4a46-bf18-f2df348abb79 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:16.403996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:16.404825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.405078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.405348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.406006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:16.408042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.523013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1036/2086] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:16 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:16.527465 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.538896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1bef0-c64f-47a2-bb58-60bf9192608d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:16.597299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:16.597941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.598252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.598528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.599195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:16.601086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.698726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1051/2087] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:16 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:16.702806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.713878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c771828-a89e-470b-930f-ea99537a99b7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:16.718816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:16.719423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.719707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.719998 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.720657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:16.722340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.734008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1037/2088] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:16.738211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.748664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0878-0026-4d0c-936b-dd530e76002d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:16.753329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:16.754021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.754311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.754590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] PATH_INFO: `/v3/projects/3b1281d0149b4b268caa8e26aefc2483/users/f24c4eb6985e43c0b4ca6ed8185df79a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.770117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1281d0149b4b268caa8e26aefc2483, user_id=f24c4eb6985e43c0b4ca6ed8185df79a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:16.772986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.886581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1052/2089] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:16 2022] PUT /identity/v3/projects/3b1281d0149b4b268caa8e26aefc2483/users/f24c4eb6985e43c0b4ca6ed8185df79a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:16.890676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.901692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55ae86-ab85-4341-b2c7-d54b66aa4fb0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:16.918146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:16.963468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a26fd-5599-4791-b7a0-e45836ff70e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:16.964098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a26fd-5599-4791-b7a0-e45836ff70e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:16.964386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a26fd-5599-4791-b7a0-e45836ff70e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:16.964661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a26fd-5599-4791-b7a0-e45836ff70e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:16.965317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a26fd-5599-4791-b7a0-e45836ff70e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:16.967043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a26fd-5599-4791-b7a0-e45836ff70e4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:16.978402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1038/2090] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:16.982287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:16.995259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f18974-d3a3-4633-a6dd-b80b5ab6749f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:17.000815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:17.001574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:17.001963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:17.002309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] PATH_INFO: `/v3/projects/3b1281d0149b4b268caa8e26aefc2483/users/f24c4eb6985e43c0b4ca6ed8185df79a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:17.004331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1281d0149b4b268caa8e26aefc2483, user_id=f24c4eb6985e43c0b4ca6ed8185df79a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:17.007517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:17.019073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1053/2091] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:16 2022] PUT /identity/v3/projects/3b1281d0149b4b268caa8e26aefc2483/users/f24c4eb6985e43c0b4ca6ed8185df79a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:17.030379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:17.030669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:17.031473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:17.063092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] MFA Rules not processed for user `f24c4eb6985e43c0b4ca6ed8185df79a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:17.064365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:17.209720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1039/2092] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:17.222663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:17.225012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:17.299553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e72b3-0e65-412d-9bf0-ae9c9430d253 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:17.303278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8b3cb-e0ee-45cc-a100-7cdc8d21b801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:17.303887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b3cb-e0ee-45cc-a100-7cdc8d21b801 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:17.304164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b3cb-e0ee-45cc-a100-7cdc8d21b801 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:17.304434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8b3cb-e0ee-45cc-a100-7cdc8d21b801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:17.314302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8b3cb-e0ee-45cc-a100-7cdc8d21b801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:17.315726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8b3cb-e0ee-45cc-a100-7cdc8d21b801 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:17.326120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1054/2093] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:17.481157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:17.548970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cdfa7-7870-43c4-a996-7b99b0d34ece None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:17.553655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:17.554352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:17.554646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:17.554925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] PATH_INFO: `/v3/users/62cf4f0510aa41dfac1452c8460b0688` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:17.556938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cf4f0510aa41dfac1452c8460b0688)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:17.558919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:17.680986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:17.814498 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cf4f0510aa41dfac1452c8460b0688'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:17.815148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cf4f0510aa41dfac1452c8460b0688'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:17.815745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cf4f0510aa41dfac1452c8460b0688'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:17.830681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cf4f0510aa41dfac1452c8460b0688'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:17.852920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cf4f0510aa41dfac1452c8460b0688'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:17.903670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:17.950392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1040/2094] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:17 2022] DELETE /identity/v3/users/62cf4f0510aa41dfac1452c8460b0688 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:17.954755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:17.955064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:17.955347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:17.974768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:17.976093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:18.035799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1055/2095] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:18.045881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:18.047299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:18.114719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f75c1-4e80-457e-bf42-d49d91bb5c49 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:18.121745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:18.122393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:18.122675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:18.122976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:18.132905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:18.135119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:18.146772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1041/2096] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:18.721558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:18.900371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:18.902555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:18.921135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddd2b-8a76-47aa-8e54-db0471160b8d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:18.928717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:18.929361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:18.929643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:18.929947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] PATH_INFO: `/v3/projects/1c4dc1a58fea4141804f179f1bdd1b25` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:18.931649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4dc1a58fea4141804f179f1bdd1b25)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:18.933734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:19.109453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4dc1a58fea4141804f179f1bdd1b25', 'request_id': 'req-7e4915cb-8328-4a22-9110-b8624ba3b1c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.114854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4dc1a58fea4141804f179f1bdd1b25', 'request_id': 'req-7e4915cb-8328-4a22-9110-b8624ba3b1c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.275378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4dc1a58fea4141804f179f1bdd1b25', 'request_id': 'req-7e4915cb-8328-4a22-9110-b8624ba3b1c5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.289361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] The token cache is being invalidate because project 1c4dc1a58fea4141804f179f1bdd1b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:19.289656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.290545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.292386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1056/2097] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:18 2022] DELETE /identity/v3/projects/1c4dc1a58fea4141804f179f1bdd1b25 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:19.306994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:19.317491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400c14c-bfb3-42cc-b11d-87d6dc2ead9b service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:19.413545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:19.414589 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:19.415246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:19.416822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] PATH_INFO: `/v3/users/f24c4eb6985e43c0b4ca6ed8185df79a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:19.418243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24c4eb6985e43c0b4ca6ed8185df79a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:19.420286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:19.647030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:19.704175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24c4eb6985e43c0b4ca6ed8185df79a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.715603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24c4eb6985e43c0b4ca6ed8185df79a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.715603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24c4eb6985e43c0b4ca6ed8185df79a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.715603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24c4eb6985e43c0b4ca6ed8185df79a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.727445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:19.730138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:19.739954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24c4eb6985e43c0b4ca6ed8185df79a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:19.802379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4915cb-8328-4a22-9110-b8624ba3b1c5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:19.809998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:19.809998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:19.809998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:19.809998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:19.810409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:19.861658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1042/2098] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:19 2022] DELETE /identity/v3/users/f24c4eb6985e43c0b4ca6ed8185df79a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:19.901978 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:19.903323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0831f-6442-4164-9803-5061c34a8f31 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:19.916177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1057/2099] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:20.138038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:20.373614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:20.380022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:20.451526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a641c21-a024-48d1-837e-4c111167207e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:20.456116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:20.456954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:20.457120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:20.457415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] PATH_INFO: `/v3/projects/3b1281d0149b4b268caa8e26aefc2483` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:20.458568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1281d0149b4b268caa8e26aefc2483)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:20.460475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:20.566708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1281d0149b4b268caa8e26aefc2483', 'request_id': 'req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:20.572539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1281d0149b4b268caa8e26aefc2483', 'request_id': 'req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:20.674853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1281d0149b4b268caa8e26aefc2483', 'request_id': 'req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:20.689001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] The token cache is being invalidate because project 3b1281d0149b4b268caa8e26aefc2483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:20.689326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:20.690165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5bcd9d3d-335f-4c56-b684-ac29c6c4f697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:20.695778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1043/2100] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:20 2022] DELETE /identity/v3/projects/3b1281d0149b4b268caa8e26aefc2483 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:20.700834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:20.701286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:20.701407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:20.723404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:20.726020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:20.800358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1058/2101] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:20.808296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:20.808828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:20.809018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:20.830665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:20.831923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:20.842606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1044/2102] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:20.847328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:20.857088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d8aa3-3426-4508-a950-f7784d303316 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:20.861761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:20.862406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:20.862687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:20.862963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:20.863692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:20.863921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:20.865517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:20.878606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1059/2103] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:39:20.883322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:20.894548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4defb9-ecd2-437e-bf7a-ea9d624ac35d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:20.899458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:20.900577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:20.900894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:20.901194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:20.901946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:20.904005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:20.990548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1045/2104] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:20 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:20.996070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.006699 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b67af-c50d-4bb5-91aa-a8db85d92f60 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.080150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.080150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.080150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.080150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.080577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.080889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.104178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:21.166908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1060/2105] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:20 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:21.171281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.182650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc781a-a2bf-4cea-b6e2-e8e537d072a0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.189733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:21.191311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.191951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.192236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.192517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.193206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.194864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.208723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1046/2106] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:21.216403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.227187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8853a-feb1-49a2-9936-4dc01bc9aca6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.235433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce68b-cbc5-4b6e-b294-5ddc9ab6d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.236066 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce68b-cbc5-4b6e-b294-5ddc9ab6d1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.236348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce68b-cbc5-4b6e-b294-5ddc9ab6d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.236624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce68b-cbc5-4b6e-b294-5ddc9ab6d1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.237611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bce68b-cbc5-4b6e-b294-5ddc9ab6d1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.239171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bce68b-cbc5-4b6e-b294-5ddc9ab6d1f5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.251850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1061/2107] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:21.257256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.268740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd71eb4-8bc8-4082-9af9-e66f95fa24a5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.273931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.274752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.274752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.274752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] PATH_INFO: `/v3/projects/bb3913f2411249268526e1e819e9cb36/users/1a013c22d7fd408392d5fa4c484a5faa/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.294432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3913f2411249268526e1e819e9cb36, user_id=1a013c22d7fd408392d5fa4c484a5faa, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.297427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.435409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1047/2108] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:21 2022] PUT /identity/v3/projects/bb3913f2411249268526e1e819e9cb36/users/1a013c22d7fd408392d5fa4c484a5faa/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:21.447587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.447872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.448148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.475411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] MFA Rules not processed for user `1a013c22d7fd408392d5fa4c484a5faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:21.476608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:21.541624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1062/2109] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:21.546336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.611248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1de006-5b1a-4120-98d9-9e8b9cc04824 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.616413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.617025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.617561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.617832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.619122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.621153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.743631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1048/2110] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:21 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:21.744856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.768244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1eaf7e-0f1d-4cc0-8bd4-fc0e8363e87a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.828437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.834533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.834533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.834533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.834533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.834533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.921146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1063/2111] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:21 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:21.925314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.936299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993ab8-570a-402c-a2b3-64b5986c8f49 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.940897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.941494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.941772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.942074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.942712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.944299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.956777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1049/2112] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:21.961222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:21.973393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10b6f-7258-49f7-bad2-604ed8bd5422 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:21.978693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ca0d-155a-4caf-ad48-bd9c07979d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:21.979295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ca0d-155a-4caf-ad48-bd9c07979d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:21.979577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ca0d-155a-4caf-ad48-bd9c07979d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:21.979851 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ca0d-155a-4caf-ad48-bd9c07979d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:21.980946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ca0d-155a-4caf-ad48-bd9c07979d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:21.982108 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ca0d-155a-4caf-ad48-bd9c07979d76 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:21.992732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1064/2113] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:21.997393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.007710 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57f5f6-9d21-4593-85ec-ae0f8159110e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.013649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.014467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.014751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.015029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] PATH_INFO: `/v3/projects/76b3d7bf8a1849bf822ab44b88e80094/users/063eb4381abc40d9b52685d5e914e88e/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.033165 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b3d7bf8a1849bf822ab44b88e80094, user_id=063eb4381abc40d9b52685d5e914e88e, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.035857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.126643 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1050/2114] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:21 2022] PUT /identity/v3/projects/76b3d7bf8a1849bf822ab44b88e80094/users/063eb4381abc40d9b52685d5e914e88e/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:22.138155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.138446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.138719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.167391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] MFA Rules not processed for user `063eb4381abc40d9b52685d5e914e88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:22.168616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:22.234412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1065/2115] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:22.239225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.310172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6a81-7dc0-4499-9951-9d944c604304 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.315419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.316029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.316370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.316646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.317279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.319193 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.371147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:22.448225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1051/2116] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:22 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:22.452713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.464430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bfdc9-db1a-45be-adfe-2373f82d024f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.546158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.547362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.547362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.547721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.548144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.550142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.659324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1066/2117] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:22 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:22.660497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.672107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e891fd-23a6-48cc-99e2-f9418518b760 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.677447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.678097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.678386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.678686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.680836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.681241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.694614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1052/2118] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:22.699283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.710489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adbd0a-d5be-43ce-96b5-cdd0883b0c19 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.716246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.716924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.717237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.717516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] PATH_INFO: `/v3/projects/66e33d8141fe4b03b1db44701f149958/users/f8e2b8de89c64f08883141aa31c19aff/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.734827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e33d8141fe4b03b1db44701f149958, user_id=f8e2b8de89c64f08883141aa31c19aff, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.739657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.757376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.759818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:22.773452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128e65-0ae2-48e9-a190-30974a111277 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.779312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.780093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.780408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.780683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] PATH_INFO: `/v3/users/a2de0290299647deb45fc5dfccb7fc55` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.781942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2de0290299647deb45fc5dfccb7fc55)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.783965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.833917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1067/2119] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:22 2022] PUT /identity/v3/projects/66e33d8141fe4b03b1db44701f149958/users/f8e2b8de89c64f08883141aa31c19aff/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:22.838935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.905200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d0496-8ec9-43f1-a014-496f5c6b21b1 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.910984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.911693 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.911975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.912279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.912909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.914562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.931562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1068/2120] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:22.932349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:22.933793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:22.944048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c5134-9560-4f9e-8092-9fa119298057 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:22.949042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992a085-26bb-4840-a283-c98c7b87013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:22.949713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a085-26bb-4840-a283-c98c7b87013c admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.950041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a085-26bb-4840-a283-c98c7b87013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.950325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992a085-26bb-4840-a283-c98c7b87013c admin admin] PATH_INFO: `/v3/projects/66e33d8141fe4b03b1db44701f149958/users/f8e2b8de89c64f08883141aa31c19aff/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.952326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992a085-26bb-4840-a283-c98c7b87013c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e33d8141fe4b03b1db44701f149958, user_id=f8e2b8de89c64f08883141aa31c19aff, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:22.955118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992a085-26bb-4840-a283-c98c7b87013c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:22.968988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1069/2121] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:22 2022] PUT /identity/v3/projects/66e33d8141fe4b03b1db44701f149958/users/f8e2b8de89c64f08883141aa31c19aff/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:22.981035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:22.981384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:22.981672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:22.984901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2de0290299647deb45fc5dfccb7fc55'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:22.986444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2de0290299647deb45fc5dfccb7fc55'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:22.987441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2de0290299647deb45fc5dfccb7fc55'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:22.997084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2de0290299647deb45fc5dfccb7fc55'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:23.011526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f000fcc6-8808-41c0-977b-2be552ab9604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2de0290299647deb45fc5dfccb7fc55'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:23.024620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] MFA Rules not processed for user `f8e2b8de89c64f08883141aa31c19aff`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:23.025979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:23.075728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1053/2122] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:22 2022] DELETE /identity/v3/users/a2de0290299647deb45fc5dfccb7fc55 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:23.080391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:23.080754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:23.081096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:23.107967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1070/2123] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:23.110287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:23.111598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:23.115875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:23.117601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:23.190148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1054/2124] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:23.193380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851efc1-d217-480a-b4f4-d575d77ee7be None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:23.202025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:23.203517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:23.251979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:23.252697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:23.253051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:23.253325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:23.269716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9245b-dbce-4c9c-9bf5-78a6cb5c8693 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:23.274433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:23.275044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:23.275509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:23.275787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:23.285648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:23.292599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:23.297238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1055/2125] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:23.318747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:23.320202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:23.331423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1071/2126] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:23.469455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:23.479451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918b37-b24e-4333-9277-fdffaed7526a service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:23.483263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:23.483866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:23.484152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:23.484425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:23.486204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:23.559304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:23.561556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:23.580086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1056/2127] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:23.981753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:23.983685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:24.003456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba17f76-a4c7-4375-ab14-172d0a35977a service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:24.009130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:24.010200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:24.010480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:24.010765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] PATH_INFO: `/v3/projects/5076846587b547bab5a68bbb3cadda9c` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:24.011997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5076846587b547bab5a68bbb3cadda9c)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:24.014000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:24.143215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5076846587b547bab5a68bbb3cadda9c', 'request_id': 'req-5c1af745-e620-482b-b8b7-885ab83850e5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.148433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5076846587b547bab5a68bbb3cadda9c', 'request_id': 'req-5c1af745-e620-482b-b8b7-885ab83850e5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.223203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5076846587b547bab5a68bbb3cadda9c', 'request_id': 'req-5c1af745-e620-482b-b8b7-885ab83850e5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.237714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] The token cache is being invalidate because project 5076846587b547bab5a68bbb3cadda9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:24.238268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.239272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.241317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1072/2128] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:23 2022] DELETE /identity/v3/projects/5076846587b547bab5a68bbb3cadda9c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:24.246470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:24.259335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3fd5b-d6a4-4669-b8a8-b3b432d63af0 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:24.319141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:24.319783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:24.320117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:24.320402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] PATH_INFO: `/v3/users/1a600b0b2af14c6aa292c660b806e910` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:24.322616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a600b0b2af14c6aa292c660b806e910)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:24.324824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:24.496437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a600b0b2af14c6aa292c660b806e910'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.498186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a600b0b2af14c6aa292c660b806e910'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.499195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a600b0b2af14c6aa292c660b806e910'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.504002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:24.523216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a600b0b2af14c6aa292c660b806e910'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.524606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:24.526329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:24.538108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cdbe8a5f-b500-412b-a977-100c66633b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a600b0b2af14c6aa292c660b806e910'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.542711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1af745-e620-482b-b8b7-885ab83850e5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:24.547443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:24.548260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:24.548542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:24.549214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] PATH_INFO: `/v3/users/6c9d700c916c46c68dd9db5b8c37ffee` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:24.550604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9d700c916c46c68dd9db5b8c37ffee)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:24.552749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:24.623578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1057/2129] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:24 2022] DELETE /identity/v3/users/1a600b0b2af14c6aa292c660b806e910 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:24.774600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9d700c916c46c68dd9db5b8c37ffee'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.857014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9d700c916c46c68dd9db5b8c37ffee'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.857737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9d700c916c46c68dd9db5b8c37ffee'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.874342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9d700c916c46c68dd9db5b8c37ffee'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.875172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9d700c916c46c68dd9db5b8c37ffee'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:24.903940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1073/2130] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:24 2022] DELETE /identity/v3/users/6c9d700c916c46c68dd9db5b8c37ffee => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:24.908391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:24.908722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:24.908979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:24.957795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:24.959358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.030127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1058/2131] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:25.042803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.044425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.105369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:25.110827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded23e-248a-4e4d-bc41-5b872b75c12d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.114670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083d0b1-1fd3-4a75-9d59-08fd5899a6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.115311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d0b1-1fd3-4a75-9d59-08fd5899a6de service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.115613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d0b1-1fd3-4a75-9d59-08fd5899a6de service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.115889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083d0b1-1fd3-4a75-9d59-08fd5899a6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.126062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083d0b1-1fd3-4a75-9d59-08fd5899a6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.127628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083d0b1-1fd3-4a75-9d59-08fd5899a6de service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.137924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1074/2132] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:25.174220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.175686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.185497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:25.201005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531455-642a-422a-99a3-47e89ddeb6f7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.206128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.206777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.207055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.207331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] PATH_INFO: `/v3/projects/d394ff8e8f4241a3be12ca627e39fc98` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.208475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d394ff8e8f4241a3be12ca627e39fc98)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.210509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.314290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd394ff8e8f4241a3be12ca627e39fc98', 'request_id': 'req-387aa333-dd8a-49bb-a8ec-adc82f364d2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.319594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd394ff8e8f4241a3be12ca627e39fc98', 'request_id': 'req-387aa333-dd8a-49bb-a8ec-adc82f364d2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.411665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd394ff8e8f4241a3be12ca627e39fc98', 'request_id': 'req-387aa333-dd8a-49bb-a8ec-adc82f364d2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.424028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] The token cache is being invalidate because project d394ff8e8f4241a3be12ca627e39fc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:25.424324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.425074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-387aa333-dd8a-49bb-a8ec-adc82f364d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.426661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1059/2133] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:25 2022] DELETE /identity/v3/projects/d394ff8e8f4241a3be12ca627e39fc98 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:25.432691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.440230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.440230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.453655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:25.454891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.517909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1075/2134] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:25.526112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.526397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.526697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.547577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:25.548866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.557615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1060/2135] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:25.561967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.572474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e56f4-6727-4f54-88bf-0136ec1f58f2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.577299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.578286 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.578743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.578970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.579634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:25.579944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.582268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.590172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.592549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.596515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1076/2136] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:25.601347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.612422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef427068-48ba-4bc7-9be9-c4a11550ab58 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.613662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfa0d9-63c0-4b14-967d-935c8e245412 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.619886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.620152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.620763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.621112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.621248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.621578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.622149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.622374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.623230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] PATH_INFO: `/v3/projects/8018175a36514f2c85d3d4c1355c1b11` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.624137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.625005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8018175a36514f2c85d3d4c1355c1b11)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.627228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.758976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1077/2137] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:25 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:25.760057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.767280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8018175a36514f2c85d3d4c1355c1b11', 'request_id': 'req-26535bfe-37d1-48b9-a525-8877177ea0e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.772953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8018175a36514f2c85d3d4c1355c1b11', 'request_id': 'req-26535bfe-37d1-48b9-a525-8877177ea0e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.821910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879f30f-9a22-41ce-a10d-b0df4b99eab5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.827364 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.828143 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.828515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.828883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.829605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.831641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.869231 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8018175a36514f2c85d3d4c1355c1b11', 'request_id': 'req-26535bfe-37d1-48b9-a525-8877177ea0e0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.881076 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] The token cache is being invalidate because project 8018175a36514f2c85d3d4c1355c1b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:25.881360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.882098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:25.883819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1061/2138] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:25 2022] DELETE /identity/v3/projects/8018175a36514f2c85d3d4c1355c1b11 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:25.887658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.888941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.952334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26535bfe-37d1-48b9-a525-8877177ea0e0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.957180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:25.957822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:25.958512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:25.958812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] PATH_INFO: `/v3/users/5e16523014d049ea9db79fc437399cdc` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:25.962221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e16523014d049ea9db79fc437399cdc)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:25.967123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:25.973747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1078/2139] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:25 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:25.974940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:25.977670 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:25.990632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0935a-972e-43c4-9e4d-fe8ee94f8789 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:25.996917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:26.004346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:26.004346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:26.004346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:26.004346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:26.004346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:26.010850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1079/2140] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:26.014914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:26.025196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89162fed-6097-4b24-85bd-7af5580e6c51 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:26.030017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:26.030683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:26.034780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:26.034780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:26.034780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:26.034780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:26.044742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1080/2141] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:26.048888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:26.059658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd581d-4c9d-41cc-9f06-41639c99c055 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:26.064338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298bb2-81c5-457e-a058-75b08145faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:26.069130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298bb2-81c5-457e-a058-75b08145faa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:26.069130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298bb2-81c5-457e-a058-75b08145faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:26.069130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298bb2-81c5-457e-a058-75b08145faa0 admin admin] PATH_INFO: `/v3/projects/af766459c85543e2a4b4e09de319bb27/users/1dcb2564e9134fa1a31bcb5a637d0623/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:26.079819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b298bb2-81c5-457e-a058-75b08145faa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af766459c85543e2a4b4e09de319bb27, user_id=1dcb2564e9134fa1a31bcb5a637d0623, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:26.082470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b298bb2-81c5-457e-a058-75b08145faa0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:26.203049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1081/2142] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:26 2022] PUT /identity/v3/projects/af766459c85543e2a4b4e09de319bb27/users/1dcb2564e9134fa1a31bcb5a637d0623/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:26.210647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:26.212210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:26.212651 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:26.238749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:26.241083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:26.248703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e16523014d049ea9db79fc437399cdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:26.249641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e16523014d049ea9db79fc437399cdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:26.252587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e16523014d049ea9db79fc437399cdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:26.263280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e16523014d049ea9db79fc437399cdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:26.278434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e16523014d049ea9db79fc437399cdc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:26.313050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1082/2143] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:26.326288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:26.327753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:26.343490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:26.386943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1062/2144] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:25 2022] DELETE /identity/v3/users/5e16523014d049ea9db79fc437399cdc => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:26.407897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fb6c7-bba8-4312-8d9a-240932119792 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:26.486340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:26.486961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:26.487292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:26.487580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:26.564857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:26.566409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:26.577650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1083/2145] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:26.743663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:26.929491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:26.931613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:26.945447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a96d1-f3b1-47cb-b191-861fd06627f0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:26.952211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:26.952863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:26.953147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:26.953426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] PATH_INFO: `/v3/projects/b33ce2dcb2e9480c9b60132cd59b8b0d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:26.954726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33ce2dcb2e9480c9b60132cd59b8b0d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:26.956667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:27.127693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33ce2dcb2e9480c9b60132cd59b8b0d', 'request_id': 'req-c6fef047-5f14-485c-bd31-217a9e066c04'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.136289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33ce2dcb2e9480c9b60132cd59b8b0d', 'request_id': 'req-c6fef047-5f14-485c-bd31-217a9e066c04'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.267463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33ce2dcb2e9480c9b60132cd59b8b0d', 'request_id': 'req-c6fef047-5f14-485c-bd31-217a9e066c04'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.279554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] The token cache is being invalidate because project b33ce2dcb2e9480c9b60132cd59b8b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:27.279842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.280490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.282071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1063/2146] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:26 2022] DELETE /identity/v3/projects/b33ce2dcb2e9480c9b60132cd59b8b0d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:27.293300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:27.297449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e7c19-b4f2-4fa6-bf0e-5decbd9cf8ed service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:27.361063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:27.361728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:27.362046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:27.362324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] PATH_INFO: `/v3/users/7d7e25256ded4642aa9966d5bb047d99` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:27.363511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7e25256ded4642aa9966d5bb047d99)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:27.365459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:27.614680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7e25256ded4642aa9966d5bb047d99'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.681105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7e25256ded4642aa9966d5bb047d99'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.682171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7e25256ded4642aa9966d5bb047d99'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.701595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7e25256ded4642aa9966d5bb047d99'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.702507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cfc16bc7-25bb-43b8-b088-7f8fcae42808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7e25256ded4642aa9966d5bb047d99'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:27.727872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1084/2147] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:27 2022] DELETE /identity/v3/users/7d7e25256ded4642aa9966d5bb047d99 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:28.066995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.068549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.081356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:28.084957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fef047-5f14-485c-bd31-217a9e066c04 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.153009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.153563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.153841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.154145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] PATH_INFO: `/v3/users/1a013c22d7fd408392d5fa4c484a5faa` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.155300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a013c22d7fd408392d5fa4c484a5faa)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.157264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:28.229156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.229498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.229787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.260604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] MFA Rules not processed for user `1dcb2564e9134fa1a31bcb5a637d0623`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:28.262404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.339669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1085/2148] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:28.341220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.342530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.356750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95ae74-f71a-417d-a6d2-9c587c7eeae9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.361387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.362193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.362476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.362749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] PATH_INFO: `/v3/projects/4ce84b6784694952a1defa2df5d19d4d` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.363990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce84b6784694952a1defa2df5d19d4d)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.365931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:28.368942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a013c22d7fd408392d5fa4c484a5faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.370343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a013c22d7fd408392d5fa4c484a5faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.371173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a013c22d7fd408392d5fa4c484a5faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.378985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a013c22d7fd408392d5fa4c484a5faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.391070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a013c22d7fd408392d5fa4c484a5faa'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.474402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1064/2149] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:28 2022] DELETE /identity/v3/users/1a013c22d7fd408392d5fa4c484a5faa => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:28.475445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.477413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.494317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:28.524225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce84b6784694952a1defa2df5d19d4d', 'request_id': 'req-85799b5c-68a5-41fe-a648-18a988ae332c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.533443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce84b6784694952a1defa2df5d19d4d', 'request_id': 'req-85799b5c-68a5-41fe-a648-18a988ae332c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.547192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c421ee-ab11-4a7a-b6c2-16ee3e1df682 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.608634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e52245-cc26-48ac-b2b2-6b1d88e20022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.609254 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e52245-cc26-48ac-b2b2-6b1d88e20022 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.609532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e52245-cc26-48ac-b2b2-6b1d88e20022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.609804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e52245-cc26-48ac-b2b2-6b1d88e20022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.610465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e52245-cc26-48ac-b2b2-6b1d88e20022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.612363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e52245-cc26-48ac-b2b2-6b1d88e20022 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:28.622422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce84b6784694952a1defa2df5d19d4d', 'request_id': 'req-85799b5c-68a5-41fe-a648-18a988ae332c'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.635201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] The token cache is being invalidate because project 4ce84b6784694952a1defa2df5d19d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:28.635513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.636199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-85799b5c-68a5-41fe-a648-18a988ae332c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:28.637759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1086/2150] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:28 2022] DELETE /identity/v3/projects/4ce84b6784694952a1defa2df5d19d4d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:28.639174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27d263-7006-4a54-b336-aa2d059fbcc3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.639296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27d263-7006-4a54-b336-aa2d059fbcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.639544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27d263-7006-4a54-b336-aa2d059fbcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.658973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cf27d263-7006-4a54-b336-aa2d059fbcc3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:28.660188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf27d263-7006-4a54-b336-aa2d059fbcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.672089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1087/2151] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:28.672089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.672089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.672089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.689789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:28.691000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.698964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1088/2152] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:28.700261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.702879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.757119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1065/2153] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:28.759517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.759804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.760083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.772344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124136bd-c559-4394-85f4-bba2a0a4e9a5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.795095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:28.796297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.840024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.840740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.841033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.841312 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.875178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:28.887661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1066/2154] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:28.892444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.894239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:28.910674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6b3ce-7536-41c3-adf2-a18cc367c84a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.917791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.920378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:28.921366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.922368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.922588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.922859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.923494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.926402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:28.933619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1089/2155] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:28.934682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.945984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c696-9f20-45a0-918b-64f70d68213f service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.951269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.951890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.952207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.952498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.956331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:28.956331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.956331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:28.977882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1090/2156] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:28.977882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:28.985982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62583d-617f-4af6-b41a-3f8b8c688725 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:28.990952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:28.991552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:28.992117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:28.992540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:28.993116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:28.995249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.053668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1067/2157] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:29.057585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.069383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb57ac-8214-4ad1-8756-59545a97baf2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.074584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.075199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.075476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.075750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.076387 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.077982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.088462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1068/2158] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:29.092685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.103404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7dec7a-30e5-4a5a-9b73-8c5a039f87df admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.108112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.111213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.111213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.111213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] PATH_INFO: `/v3/projects/76ca1ad399644000b2fd2cf32e8712f3/users/536487cebc364b26b2ab55d10aa666f3/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.127092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca1ad399644000b2fd2cf32e8712f3, user_id=536487cebc364b26b2ab55d10aa666f3, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.129828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.153612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1091/2159] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:28 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:29.158086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.225695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3641d-4432-4e40-9347-cce8ff973a61 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.231186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.231829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.232350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.232548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.233178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.235130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.274696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1069/2160] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:29 2022] PUT /identity/v3/projects/76ca1ad399644000b2fd2cf32e8712f3/users/536487cebc364b26b2ab55d10aa666f3/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:29.278646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.344098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538de8b6-09fb-47de-bcdc-d10a9b3f35f8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.351173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.352399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.352758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.353167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.353887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.355606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.366207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1070/2161] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:29.370812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.380786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54beb17-80f9-468c-928e-707d0cedc78b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.382882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1092/2162] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:29 2022] POST /identity/v3/users => generated 305 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:29.387287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.387448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.387961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.388804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.388804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] PATH_INFO: `/v3/projects/76ca1ad399644000b2fd2cf32e8712f3/users/536487cebc364b26b2ab55d10aa666f3/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.390482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca1ad399644000b2fd2cf32e8712f3, user_id=536487cebc364b26b2ab55d10aa666f3, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.393229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.401248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690fbac-18df-406f-a927-d1320d40511d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.405470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1071/2163] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:29 2022] PUT /identity/v3/projects/76ca1ad399644000b2fd2cf32e8712f3/users/536487cebc364b26b2ab55d10aa666f3/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:29.478705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.480154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.480154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.480154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.480727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.482398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.493491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1093/2164] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:29.498071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.510212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b6f8-44db-4908-ad74-9e4b9d41621a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.515114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.515704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.515989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.516262 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.516907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.518551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.530604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1072/2165] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:29.534731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.545754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b506bd-7f9f-427d-8786-c5df1c389845 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.550484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a2a7c-0acd-45af-9066-a1183120f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.551152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a2a7c-0acd-45af-9066-a1183120f02a admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.551427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a2a7c-0acd-45af-9066-a1183120f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.551753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a2a7c-0acd-45af-9066-a1183120f02a admin admin] PATH_INFO: `/v3/projects/d74bf7a7d98a4b06b778d8e1064143d4/users/c8c56f51fcb342b48ae32cb0877da512/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.573810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.583630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a2a7c-0acd-45af-9066-a1183120f02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74bf7a7d98a4b06b778d8e1064143d4, user_id=c8c56f51fcb342b48ae32cb0877da512, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.587664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a2a7c-0acd-45af-9066-a1183120f02a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.588802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:29.604350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057e130-dd87-4b40-ba5b-a491134a6e74 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.609425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.610139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.610422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.610698 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] PATH_INFO: `/v3/projects/bb3913f2411249268526e1e819e9cb36` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.611941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3913f2411249268526e1e819e9cb36)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.613891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.703714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1094/2166] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:29 2022] PUT /identity/v3/projects/d74bf7a7d98a4b06b778d8e1064143d4/users/c8c56f51fcb342b48ae32cb0877da512/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:29.717060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.717266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.717518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.722109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:29.740523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3913f2411249268526e1e819e9cb36', 'request_id': 'req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:29.748621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3913f2411249268526e1e819e9cb36', 'request_id': 'req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:29.763548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] MFA Rules not processed for user `c8c56f51fcb342b48ae32cb0877da512`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:29.764843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:29.816075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3913f2411249268526e1e819e9cb36', 'request_id': 'req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:29.834085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] The token cache is being invalidate because project bb3913f2411249268526e1e819e9cb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:29.834492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:29.835110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:29.838278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1073/2167] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:29 2022] DELETE /identity/v3/projects/bb3913f2411249268526e1e819e9cb36 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:29.842031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.843489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:29.860779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1095/2168] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:29.862039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:29.863466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:29.927483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0933f-87e9-4ba9-b101-dc4604ffc98f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.933011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.933645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.933957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.935304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b1aa4-70d3-4ee2-9988-58c7087f317b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:29.940554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] PATH_INFO: `/v3/users/063eb4381abc40d9b52685d5e914e88e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.940690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:29.941124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:29.941324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:29.941600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:29.941957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] RBAC: Authorizing `identity:delete_user(user_id=063eb4381abc40d9b52685d5e914e88e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.942308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:29.944263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:29.951797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:30.136278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1096/2169] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:29 2022] POST /identity/v3/projects => generated 407 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:30.143466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.183323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063eb4381abc40d9b52685d5e914e88e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:30.184675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063eb4381abc40d9b52685d5e914e88e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:30.185473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063eb4381abc40d9b52685d5e914e88e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:30.188600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:30.196404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063eb4381abc40d9b52685d5e914e88e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:30.210227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063eb4381abc40d9b52685d5e914e88e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:30.219918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c75d-bd2d-40c0-8572-b4ee8ac46d1f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:30.225000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:30.225576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:30.225914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:30.226220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:30.227455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:30.238967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:30.349111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1074/2170] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:29 2022] DELETE /identity/v3/users/063eb4381abc40d9b52685d5e914e88e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:30.390260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1097/2171] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:30 2022] POST /identity/v3/users => generated 310 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:30.394419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.396128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:30.466142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee4422-44b9-4bb0-99c9-2c3ccfd8472d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:30.470959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:30.471603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:30.471850 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:30.472211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:30.472886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:30.474521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:30.485010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1075/2172] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:30.489507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.500666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94565-2c2d-49f0-9926-dc6ada68bd3c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:30.505436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:30.506162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:30.508857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:30.508857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] PATH_INFO: `/v3/projects/339bf91de51544eea0b3e7e82d08513e/users/6622e5b1bf1d44639ff03005468615fa/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:30.522586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=339bf91de51544eea0b3e7e82d08513e, user_id=6622e5b1bf1d44639ff03005468615fa, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:30.525340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:30.627684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1098/2173] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:30 2022] PUT /identity/v3/projects/339bf91de51544eea0b3e7e82d08513e/users/6622e5b1bf1d44639ff03005468615fa/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:30.641497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.652868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ccea-a14e-4562-b9d8-e76fa0a9ab99 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:30.713043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356d085-5a02-42a9-a0c3-9e6aa06ad961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:30.713658 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356d085-5a02-42a9-a0c3-9e6aa06ad961 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:30.713971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356d085-5a02-42a9-a0c3-9e6aa06ad961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:30.714246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356d085-5a02-42a9-a0c3-9e6aa06ad961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:30.714889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356d085-5a02-42a9-a0c3-9e6aa06ad961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:30.716479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356d085-5a02-42a9-a0c3-9e6aa06ad961 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:30.719062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:30.727117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1076/2174] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:30.731934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.744604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56931a-9237-471a-ad26-8a56f70ee5bc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:30.749363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:30.750054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:30.750344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:30.750623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] PATH_INFO: `/v3/projects/339bf91de51544eea0b3e7e82d08513e/users/6622e5b1bf1d44639ff03005468615fa/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:30.752537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=339bf91de51544eea0b3e7e82d08513e, user_id=6622e5b1bf1d44639ff03005468615fa, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:30.755308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:30.766742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1099/2175] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:30 2022] PUT /identity/v3/projects/339bf91de51544eea0b3e7e82d08513e/users/6622e5b1bf1d44639ff03005468615fa/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:30.782661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:30.782932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:30.783218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:30.819861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] MFA Rules not processed for user `6622e5b1bf1d44639ff03005468615fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:30.822256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:30.893923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.896072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:30.899831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1077/2176] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:30.909406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:30.911274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:30.999741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279886-2920-4651-878b-dd0ec906df2e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:31.002899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731a792-67bf-406f-970e-56910ffc51ec None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:31.005239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:31.006653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.006941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.007080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910dd63-c4b0-4646-b590-d98cb7710f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:31.007213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] PATH_INFO: `/v3/projects/76b3d7bf8a1849bf822ab44b88e80094` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.008143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910dd63-c4b0-4646-b590-d98cb7710f96 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.008143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910dd63-c4b0-4646-b590-d98cb7710f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.008421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910dd63-c4b0-4646-b590-d98cb7710f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.010665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b3d7bf8a1849bf822ab44b88e80094)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:31.013221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:31.021367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910dd63-c4b0-4646-b590-d98cb7710f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:31.027743 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910dd63-c4b0-4646-b590-d98cb7710f96 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:31.039517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1078/2177] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:31.089993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcc76-2eb5-4a74-8fd2-ea68ff1a0caa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.090289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcc76-2eb5-4a74-8fd2-ea68ff1a0caa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.090570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdcc76-2eb5-4a74-8fd2-ea68ff1a0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.125159 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d3bdcc76-2eb5-4a74-8fd2-ea68ff1a0caa None None] MFA Rules not processed for user `536487cebc364b26b2ab55d10aa666f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:31.126872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d3bdcc76-2eb5-4a74-8fd2-ea68ff1a0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.182271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b3d7bf8a1849bf822ab44b88e80094', 'request_id': 'req-07b1df58-c908-4c4a-8820-877b79119860'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.188037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b3d7bf8a1849bf822ab44b88e80094', 'request_id': 'req-07b1df58-c908-4c4a-8820-877b79119860'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.203211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1079/2178] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:31.214179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.214466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.214748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.233760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] MFA Rules not processed for user `1dcb2564e9134fa1a31bcb5a637d0623`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:31.235167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.280027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b3d7bf8a1849bf822ab44b88e80094', 'request_id': 'req-07b1df58-c908-4c4a-8820-877b79119860'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.293022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] The token cache is being invalidate because project 76b3d7bf8a1849bf822ab44b88e80094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:31.293443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.294183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.295803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1100/2179] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:30 2022] DELETE /identity/v3/projects/76b3d7bf8a1849bf822ab44b88e80094 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:31.300644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1080/2180] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:31.300764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:31.302040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.311657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:31.313081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.379830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1df58-c908-4c4a-8820-877b79119860 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:31.391552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:31.397546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.397546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.397546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] PATH_INFO: `/v3/users/f8e2b8de89c64f08883141aa31c19aff` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.397546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e2b8de89c64f08883141aa31c19aff)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:31.397546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:31.400365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff87b8e-8e5a-4ce4-bef8-451fb5681f4a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:31.407378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:31.408034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.408318 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.408593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.410752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.422673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:31.424378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:31.434879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1081/2181] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:31.462736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:31.480418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:31.481834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.548649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf56d-e453-4a4d-a593-de598c8a2c13 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:31.552349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:31.553374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:31.553908 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:31.554383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:31.558903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:31.627919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:31.629356 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:31.640434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1082/2182] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:31 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:31.685384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e2b8de89c64f08883141aa31c19aff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.782566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e2b8de89c64f08883141aa31c19aff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.783271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e2b8de89c64f08883141aa31c19aff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.797045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e2b8de89c64f08883141aa31c19aff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.797792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5bd40283-e211-4e67-ad71-34745b82bcbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e2b8de89c64f08883141aa31c19aff'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:31.811935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1101/2183] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:31 2022] DELETE /identity/v3/users/f8e2b8de89c64f08883141aa31c19aff => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:32.388838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:32.410519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacde86c-71c8-4184-9911-ea4e447a28b5 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:32.562223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:32.571408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:32.571408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:32.571408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] PATH_INFO: `/v3/projects/66e33d8141fe4b03b1db44701f149958` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:32.571408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e33d8141fe4b03b1db44701f149958)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:32.571408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:32.774470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e33d8141fe4b03b1db44701f149958', 'request_id': 'req-c742e88b-4b8e-44bd-8376-b9dd003a21e3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:32.779240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e33d8141fe4b03b1db44701f149958', 'request_id': 'req-c742e88b-4b8e-44bd-8376-b9dd003a21e3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:32.885374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e33d8141fe4b03b1db44701f149958', 'request_id': 'req-c742e88b-4b8e-44bd-8376-b9dd003a21e3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:32.897249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] The token cache is being invalidate because project 66e33d8141fe4b03b1db44701f149958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:32.897535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:32.898215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c742e88b-4b8e-44bd-8376-b9dd003a21e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:32.899857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1083/2184] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:32 2022] DELETE /identity/v3/projects/66e33d8141fe4b03b1db44701f149958 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:32.905780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:32.906361 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:32.906520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:32.935268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:32.936656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:32.997743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1102/2185] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:33.006015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.006300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.006573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.027966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:33.029302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:33.037368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1084/2186] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:33.042254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.052537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32fe89-053a-4664-8fe3-4b71f47d016f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.058101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.061377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.061377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.061377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.061377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:33.061377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.062344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.074961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1103/2187] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:39:33.079638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.089094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b9bc2-40d9-4abc-8037-a50c7fcf10b7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.094031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.094644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.100012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.100012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.100012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.100012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.244996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1085/2188] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:33 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:33.253814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.264162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31c2a5-6bce-429c-adb7-885f00542266 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.327545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.328191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.328490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.328770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.329457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.331538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.488611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1104/2189] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:33 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:33.489789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.502022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26a006-3696-4d53-8efc-c4fc771872c5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.507125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.508631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.508993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.509968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.510645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.512797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.524709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1086/2190] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:39:33.528852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.540151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc981-88e5-41b4-afd0-04fd0df4de09 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.545192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8257e-09ed-4a14-9dad-72b753c10ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.545828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8257e-09ed-4a14-9dad-72b753c10ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.546150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8257e-09ed-4a14-9dad-72b753c10ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.546499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8257e-09ed-4a14-9dad-72b753c10ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.547183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8257e-09ed-4a14-9dad-72b753c10ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.548773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8257e-09ed-4a14-9dad-72b753c10ab5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.560575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1105/2191] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:33.566702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.575372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b50f3e-4a59-4a83-9a7a-919038ab47ce admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.579940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.580629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.580923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.581195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] PATH_INFO: `/v3/projects/edbe1217eaaa4f9987359bde15e4b9c5/users/1ed3262c40c341ae8b3c8ac6177e943a/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.593753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:33.596915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbe1217eaaa4f9987359bde15e4b9c5, user_id=1ed3262c40c341ae8b3c8ac6177e943a, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.599619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.763328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1087/2192] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:33 2022] PUT /identity/v3/projects/edbe1217eaaa4f9987359bde15e4b9c5/users/1ed3262c40c341ae8b3c8ac6177e943a/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:33.775347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.775658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.775943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.807264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] MFA Rules not processed for user `1ed3262c40c341ae8b3c8ac6177e943a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:33.808594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:33.854972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:33.901124 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1106/2193] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:33.905552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:33.985172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc8ee-b852-48f0-bd13-7407abd51cf2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.990597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.991228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.991761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.992412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.993116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.995129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.097301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1088/2194] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:33 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:34.101031 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.113304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9be413-f7ac-4399-b7c5-639e1a93de36 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.170943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.171566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.171845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.172120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.172758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.174792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.291047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1107/2195] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:34 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:34.295575 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.309657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b3e47-966b-4a31-9295-1d651fc11aac admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.315649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.315649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.315929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.316204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.316885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.322625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.330309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1089/2196] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:34.334661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.346004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f0893-cc84-4f3c-8016-1eb09d840e9f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.350940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.354079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.354079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.354079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] PATH_INFO: `/v3/projects/c7d48114ce984fdeadcaac03d433eb07/users/45457bc302d94b5383fdc610724a4541/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.372330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d48114ce984fdeadcaac03d433eb07, user_id=45457bc302d94b5383fdc610724a4541, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.375461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.518832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1108/2197] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:34 2022] PUT /identity/v3/projects/c7d48114ce984fdeadcaac03d433eb07/users/45457bc302d94b5383fdc610724a4541/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:34.521518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.532940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d479f73-f9cf-45c2-afbe-2ec5c73762fa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.612201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f1e9-061d-4731-beb8-9e2df3015472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.612754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f1e9-061d-4731-beb8-9e2df3015472 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.613040 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f1e9-061d-4731-beb8-9e2df3015472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.613316 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f1e9-061d-4731-beb8-9e2df3015472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.613999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29f1e9-061d-4731-beb8-9e2df3015472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.615693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29f1e9-061d-4731-beb8-9e2df3015472 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.627491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1090/2198] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:34.631964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.643748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f397dab-00ef-4685-a41c-3829cf2d7b4a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.648615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd63b2e-96db-4705-b246-b3761c630da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.649605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63b2e-96db-4705-b246-b3761c630da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.649915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63b2e-96db-4705-b246-b3761c630da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.650192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63b2e-96db-4705-b246-b3761c630da8 admin admin] PATH_INFO: `/v3/projects/c7d48114ce984fdeadcaac03d433eb07/users/45457bc302d94b5383fdc610724a4541/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.652197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd63b2e-96db-4705-b246-b3761c630da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d48114ce984fdeadcaac03d433eb07, user_id=45457bc302d94b5383fdc610724a4541, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.654907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd63b2e-96db-4705-b246-b3761c630da8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.666984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1109/2199] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:34 2022] PUT /identity/v3/projects/c7d48114ce984fdeadcaac03d433eb07/users/45457bc302d94b5383fdc610724a4541/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:34.678291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.678633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.679553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.713452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] MFA Rules not processed for user `45457bc302d94b5383fdc610724a4541`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:34.714685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:34.720528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.720821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.721104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.746035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:34.747355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:34.798756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1091/2200] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:34.823199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.824982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:34.833946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1110/2201] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:39:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:34.884867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:34.886843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:34.894406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42958d-2e85-455b-8de1-764f9741138b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.898153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77a26-1bd2-42ff-be2b-e2efc117dccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.898956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77a26-1bd2-42ff-be2b-e2efc117dccc service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.899238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77a26-1bd2-42ff-be2b-e2efc117dccc service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.899513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77a26-1bd2-42ff-be2b-e2efc117dccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.962757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8767c-7777-4f9c-b4fd-6db8e261fe20 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:34.963248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf77a26-1bd2-42ff-be2b-e2efc117dccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.964799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf77a26-1bd2-42ff-be2b-e2efc117dccc service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.968997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:34.969628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:34.969934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:34.970303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:34.978749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1092/2202] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:34.983141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:34.985186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:34.995444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1111/2203] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:39:35.349613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:35.606348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:36.332830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237b6a-d2da-4ca6-93e6-429360aa7f8e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:36.334828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237b6a-d2da-4ca6-93e6-429360aa7f8e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:36.335336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83237b6a-d2da-4ca6-93e6-429360aa7f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:36.373675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-83237b6a-d2da-4ca6-93e6-429360aa7f8e None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:36.375875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-83237b6a-d2da-4ca6-93e6-429360aa7f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:36.388973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1093/2204] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 24 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:36.406899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:36.419232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67137668-6361-41b6-9b84-570c59cee307 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:36.426017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:36.426966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:36.430342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:36.430342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:36.438940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:36.441206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:36.453566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1112/2205] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:39:37.125616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:37.385413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dc72-38a5-442d-b380-1b002967393a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:37.387350 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dc72-38a5-442d-b380-1b002967393a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:37.387633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dc72-38a5-442d-b380-1b002967393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:37.408349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3031dc72-38a5-442d-b380-1b002967393a None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:37.413833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3031dc72-38a5-442d-b380-1b002967393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:37.417996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1094/2206] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:37.432335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:37.433642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:37.449034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0bacd-371c-4cab-89bc-25194b14f540 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:37.456655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:37.456655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:37.456655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:37.456655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:37.465646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:37.467790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:37.478131 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1113/2207] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:39:38.229448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:38.229740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:38.230060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:38.252717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:38.254117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:38.263379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1095/2208] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 24 09:39:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:38.284576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:38.288060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9fbdb-62c6-4b36-9635-839e53bdae2b service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:38.294567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84c53f-4ce8-4991-a4cf-48300223e33d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:38.295285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84c53f-4ce8-4991-a4cf-48300223e33d service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:38.295638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84c53f-4ce8-4991-a4cf-48300223e33d service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:38.295983 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84c53f-4ce8-4991-a4cf-48300223e33d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:38.308153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84c53f-4ce8-4991-a4cf-48300223e33d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:38.310182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84c53f-4ce8-4991-a4cf-48300223e33d service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:38.318544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1114/2209] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:39:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:39:39.543102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:39.644622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:39.725946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2e6e6-4716-47c7-879a-cdf78709b139 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:39.731468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:39.732267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:39.732559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:39.732834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] PATH_INFO: `/v3/users/1ed3262c40c341ae8b3c8ac6177e943a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:39.734005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed3262c40c341ae8b3c8ac6177e943a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:39.735973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:39.962722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed3262c40c341ae8b3c8ac6177e943a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:39.963538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed3262c40c341ae8b3c8ac6177e943a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:39.964150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed3262c40c341ae8b3c8ac6177e943a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:39.971899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed3262c40c341ae8b3c8ac6177e943a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:39.985230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed3262c40c341ae8b3c8ac6177e943a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:40.011053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:40.105381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1096/2210] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:39 2022] DELETE /identity/v3/users/1ed3262c40c341ae8b3c8ac6177e943a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:40.109925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.110222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.110505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.142043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:40.142043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.201825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1115/2211] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:40.216628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:40.218435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.282614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46ab4a-ba0e-4c3f-8010-9a815688e2a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:40.289026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ca46a-3ad2-4753-a1f8-e68a6034055e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:40.290163 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ca46a-3ad2-4753-a1f8-e68a6034055e service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.290888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ca46a-3ad2-4753-a1f8-e68a6034055e service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.291324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ca46a-3ad2-4753-a1f8-e68a6034055e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.309250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ca46a-3ad2-4753-a1f8-e68a6034055e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:40.310121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ca46a-3ad2-4753-a1f8-e68a6034055e service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:40.314721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:40.316382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.330453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c55c-acfb-4c7d-a192-f11c9e58555d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:40.331489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1097/2212] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:40.345100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:40.345892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.346279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.346889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] PATH_INFO: `/v3/users/c8c56f51fcb342b48ae32cb0877da512` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.348266 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c56f51fcb342b48ae32cb0877da512)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:40.350441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:40.555592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c56f51fcb342b48ae32cb0877da512'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:40.650429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c56f51fcb342b48ae32cb0877da512'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:40.651213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c56f51fcb342b48ae32cb0877da512'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:40.664477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c56f51fcb342b48ae32cb0877da512'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:40.665219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c56f51fcb342b48ae32cb0877da512'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:40.680644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1116/2213] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:40 2022] DELETE /identity/v3/users/c8c56f51fcb342b48ae32cb0877da512 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:40.685242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.685762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.686105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.796606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:40.798856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.842446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:40.843824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.892335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63246a68-c693-49f3-b311-293b07e458e8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:40.897725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:40.898686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.898972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.899254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] PATH_INFO: `/v3/projects/edbe1217eaaa4f9987359bde15e4b9c5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.900489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbe1217eaaa4f9987359bde15e4b9c5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:40.902447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:40.916758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1098/2214] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:40.926893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:40.928515 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.996058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af722fb-a369-4603-af7e-25d0b99d6c16 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:40.999664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:41.000550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:41.000932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:41.001403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:41.011531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:41.013075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:41.022712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1099/2215] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:41.063502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbe1217eaaa4f9987359bde15e4b9c5', 'request_id': 'req-034463c6-d902-46b3-8063-d75709315a96'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.076024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbe1217eaaa4f9987359bde15e4b9c5', 'request_id': 'req-034463c6-d902-46b3-8063-d75709315a96'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.198719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbe1217eaaa4f9987359bde15e4b9c5', 'request_id': 'req-034463c6-d902-46b3-8063-d75709315a96'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.214838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] The token cache is being invalidate because project edbe1217eaaa4f9987359bde15e4b9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:41.215197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.215871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.220411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1117/2216] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:40 2022] DELETE /identity/v3/projects/edbe1217eaaa4f9987359bde15e4b9c5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:41.222244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:41.234019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:41.239341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fe2a5-f95e-435b-9e45-a2e1000c5e1f service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:41.318499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:41.319412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:41.320463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:41.320463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] PATH_INFO: `/v3/users/45457bc302d94b5383fdc610724a4541` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:41.321986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45457bc302d94b5383fdc610724a4541)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:41.324267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:41.376234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:41.501969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:41.501969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:41.514462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034463c6-d902-46b3-8063-d75709315a96 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:41.519496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:41.520163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:41.520480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:41.520753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] PATH_INFO: `/v3/projects/d74bf7a7d98a4b06b778d8e1064143d4` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:41.521881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74bf7a7d98a4b06b778d8e1064143d4)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:41.524235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:41.567453 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45457bc302d94b5383fdc610724a4541'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.568134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45457bc302d94b5383fdc610724a4541'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.568869 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45457bc302d94b5383fdc610724a4541'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.576211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45457bc302d94b5383fdc610724a4541'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.589337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45457bc302d94b5383fdc610724a4541'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.628927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74bf7a7d98a4b06b778d8e1064143d4', 'request_id': 'req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.634600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74bf7a7d98a4b06b778d8e1064143d4', 'request_id': 'req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.680271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1100/2217] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:41 2022] DELETE /identity/v3/users/45457bc302d94b5383fdc610724a4541 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:41.681179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:41.682539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:41.742770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74bf7a7d98a4b06b778d8e1064143d4', 'request_id': 'req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.753721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc000496-7043-43b0-b0c3-4a8f64c2da07 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:41.756835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] The token cache is being invalidate because project d74bf7a7d98a4b06b778d8e1064143d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:41.757354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.758383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.759363 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:41.760325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:41.760549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1118/2218] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:41 2022] DELETE /identity/v3/projects/d74bf7a7d98a4b06b778d8e1064143d4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:41.760638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:41.760969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] PATH_INFO: `/v3/users/ee278bac0d3c482ba89f9d5a2315681b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:41.762258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee278bac0d3c482ba89f9d5a2315681b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:41.764366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:41.764691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:41.765850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:41.830098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf6c9e-d4a3-4b37-9fb4-987b56227f89 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:41.834889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:41.836164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:41.836668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:41.836976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] PATH_INFO: `/v3/users/6622e5b1bf1d44639ff03005468615fa` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:41.838186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6622e5b1bf1d44639ff03005468615fa)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:41.843814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:41.991532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee278bac0d3c482ba89f9d5a2315681b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.993405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee278bac0d3c482ba89f9d5a2315681b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:41.994239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee278bac0d3c482ba89f9d5a2315681b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.002088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee278bac0d3c482ba89f9d5a2315681b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.015375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee278bac0d3c482ba89f9d5a2315681b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.084011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:42.156282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6622e5b1bf1d44639ff03005468615fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.184404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1101/2219] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:41 2022] DELETE /identity/v3/users/ee278bac0d3c482ba89f9d5a2315681b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:42.186144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:42.196393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:42.292205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:42.297059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16f379-adec-49a0-8297-ce906b9cd05b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:42.307287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:42.308020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.312687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.312687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] PATH_INFO: `/v3/projects/c7d48114ce984fdeadcaac03d433eb07` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.314431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d48114ce984fdeadcaac03d433eb07)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:42.317679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:42.329759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6622e5b1bf1d44639ff03005468615fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.330565 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6622e5b1bf1d44639ff03005468615fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.348879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6622e5b1bf1d44639ff03005468615fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.350301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fa6173dc-1f17-4124-b9fb-83616a11d0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6622e5b1bf1d44639ff03005468615fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.367661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1119/2220] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:41 2022] DELETE /identity/v3/users/6622e5b1bf1d44639ff03005468615fa => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:42.369205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6e58f-e654-40ab-9e45-86d7722ad825 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.369491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6e58f-e654-40ab-9e45-86d7722ad825 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.369759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6e58f-e654-40ab-9e45-86d7722ad825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.400346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9bc6e58f-e654-40ab-9e45-86d7722ad825 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:42.401622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9bc6e58f-e654-40ab-9e45-86d7722ad825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:42.426779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d48114ce984fdeadcaac03d433eb07', 'request_id': 'req-34560053-2119-403e-ab4a-2ce7067f5f59'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.433595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d48114ce984fdeadcaac03d433eb07', 'request_id': 'req-34560053-2119-403e-ab4a-2ce7067f5f59'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.501954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d48114ce984fdeadcaac03d433eb07', 'request_id': 'req-34560053-2119-403e-ab4a-2ce7067f5f59'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.502622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1120/2221] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:42.518859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] The token cache is being invalidate because project c7d48114ce984fdeadcaac03d433eb07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:42.519852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.520571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:42.524185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1102/2222] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:42 2022] DELETE /identity/v3/projects/c7d48114ce984fdeadcaac03d433eb07 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:42.529424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625fcd-19c4-4230-a12c-ccd30655c477 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.529773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625fcd-19c4-4230-a12c-ccd30655c477 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.530229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625fcd-19c4-4230-a12c-ccd30655c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.536024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:42.538087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:42.563199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-61625fcd-19c4-4230-a12c-ccd30655c477 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:42.564354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-61625fcd-19c4-4230-a12c-ccd30655c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:42.639984 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34560053-2119-403e-ab4a-2ce7067f5f59 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:42.645033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:42.645716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.646099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.646735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.649563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:42.655208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1121/2223] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:42.663452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:42.665045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:42.667655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.671540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.671540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.678458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1103/2224] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:42.702487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:42.704363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:42.715856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1122/2225] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:42.722866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:42.735269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869aced-7426-472b-8bbc-b7fa32ce7588 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:42.743320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:42.744197 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.746138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.746138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.746138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:42.746138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:42.747911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:42.775803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1104/2226] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:42.781824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:42.791816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d36d9-a6e7-4a8d-a097-f0e45d2bb840 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:42.797290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:42.798145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:42.798145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:42.798572 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:42.799094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:42.801052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:42.860946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:42.904811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1123/2227] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:42 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:42.909209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:42.920832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9597-9eb1-46cb-b24d-9c4f8af24502 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.006797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.008023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.009978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.010665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.011361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.014179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.047061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.053164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.082783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027c03-b592-4a2f-9edc-99a01a376621 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.089529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.090221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.090502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.090773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] PATH_INFO: `/v3/projects/f4cb05c5435b4feca560242cef13c3d3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.092096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cb05c5435b4feca560242cef13c3d3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.094418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.123457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1105/2228] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:42 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:43.124390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.129847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.145953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2789b-8442-46d0-974b-e5f96e70d94f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.151568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.152215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.152503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.152790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] PATH_INFO: `/v3/projects/339bf91de51544eea0b3e7e82d08513e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.154299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=339bf91de51544eea0b3e7e82d08513e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.156167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.258524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cb05c5435b4feca560242cef13c3d3', 'request_id': 'req-53383f42-f9f4-4133-99a7-e47c9dc7a948'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.264750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cb05c5435b4feca560242cef13c3d3', 'request_id': 'req-53383f42-f9f4-4133-99a7-e47c9dc7a948'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.313366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339bf91de51544eea0b3e7e82d08513e', 'request_id': 'req-766bcd21-15c6-4288-981f-1ae891a6c7df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.319023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339bf91de51544eea0b3e7e82d08513e', 'request_id': 'req-766bcd21-15c6-4288-981f-1ae891a6c7df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.364600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cb05c5435b4feca560242cef13c3d3', 'request_id': 'req-53383f42-f9f4-4133-99a7-e47c9dc7a948'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.379814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] The token cache is being invalidate because project f4cb05c5435b4feca560242cef13c3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:43.380107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.380793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.385107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1124/2229] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:43 2022] DELETE /identity/v3/projects/f4cb05c5435b4feca560242cef13c3d3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:39:43.386437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.390897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.441617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339bf91de51544eea0b3e7e82d08513e', 'request_id': 'req-766bcd21-15c6-4288-981f-1ae891a6c7df'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.467887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] The token cache is being invalidate because project 339bf91de51544eea0b3e7e82d08513e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:43.468307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.472018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-766bcd21-15c6-4288-981f-1ae891a6c7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:43.480332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1106/2230] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:43 2022] DELETE /identity/v3/projects/339bf91de51544eea0b3e7e82d08513e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:43.485675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abfe7-b41e-4fc7-bec3-a4f128849eef None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.485985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abfe7-b41e-4fc7-bec3-a4f128849eef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.486291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6abfe7-b41e-4fc7-bec3-a4f128849eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.536026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3a6abfe7-b41e-4fc7-bec3-a4f128849eef None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:43.540085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3a6abfe7-b41e-4fc7-bec3-a4f128849eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.544671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383f42-f9f4-4133-99a7-e47c9dc7a948 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.627486 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.628362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.628869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.629430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.630954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.634182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.657737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1125/2231] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:43.662660 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.665804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.679998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f053d7-e4e3-4e4c-8949-9e8d64580412 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.691546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1107/2232] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:43.692945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.693694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.694059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.694507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.695590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.697529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.702611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883674-0515-472a-bb09-def8768134bd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.702903 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883674-0515-472a-bb09-def8768134bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.703323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883674-0515-472a-bb09-def8768134bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.718229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1126/2233] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:43.722097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.734980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b3883674-0515-472a-bb09-def8768134bd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:43.736229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b3883674-0515-472a-bb09-def8768134bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.749550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48091257-12e0-4018-a77c-23faaf03f69a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.749721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1108/2234] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:43.750607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3883674-0515-472a-bb09-def8768134bd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.755891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4eb42-b819-4bcf-828b-2c6fe2dbc8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.757682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4eb42-b819-4bcf-828b-2c6fe2dbc8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.758879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4eb42-b819-4bcf-828b-2c6fe2dbc8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.759219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4eb42-b819-4bcf-828b-2c6fe2dbc8f2 admin admin] PATH_INFO: `/v3/projects/0da6643f614e4ac9a7e5dbfb6df2d615/users/1905dfbded714f4a9dc283d24f80ff38/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.761566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3883674-0515-472a-bb09-def8768134bd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.780365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.781836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.781836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.781836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.782343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:43.782652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.784557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.791358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4eb42-b819-4bcf-828b-2c6fe2dbc8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da6643f614e4ac9a7e5dbfb6df2d615, user_id=1905dfbded714f4a9dc283d24f80ff38, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.794900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4eb42-b819-4bcf-828b-2c6fe2dbc8f2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.798659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1109/2235] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:43.804730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:43.816624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de08d-e8c5-4c5c-a0e9-35eac62b4e52 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:43.839948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:43.845016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.845016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.845016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.845016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:43.845016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:43.891818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1127/2236] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:43 2022] PUT /identity/v3/projects/0da6643f614e4ac9a7e5dbfb6df2d615/users/1905dfbded714f4a9dc283d24f80ff38/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:43.911437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.912098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.912540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.954098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] MFA Rules not processed for user `1905dfbded714f4a9dc283d24f80ff38`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:43.955515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.989225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1110/2237] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:43 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:43.989225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.065734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:44.070943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1128/2238] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:44.086247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.088285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:44.097608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e82859-716c-4bc8-82e7-0a73210be6e7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.105345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.106157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.106452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.106991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.107732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.110068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.176504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:44.206337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aa23d-2c03-4e4d-89f6-316e5aa68aab None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.236655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1111/2239] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:43 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:44.240374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.253220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a5610-0b51-40a5-a6db-0f5271a62162 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.266137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.266880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.267171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.267493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.268141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.270330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.280204 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db32af5-3eb4-4774-aeb1-871fa89669e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.281146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db32af5-3eb4-4774-aeb1-871fa89669e1 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.281590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db32af5-3eb4-4774-aeb1-871fa89669e1 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.282012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db32af5-3eb4-4774-aeb1-871fa89669e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.288276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1112/2240] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:44.289308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.301784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d60d6-484f-4165-b1ba-de584cc2c24d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.309225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.310602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.310602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.310602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.311595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.313006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.324858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1113/2241] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:44.330451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.342461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4ef4-d713-4a66-a069-8dc30acf9e85 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.347684 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.348333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.348615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.348894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] PATH_INFO: `/v3/projects/25a7080057434ddc80db09cf6420527b/users/da835147184146b58283f65db5ed6d96/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.362061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db32af5-3eb4-4774-aeb1-871fa89669e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.363764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db32af5-3eb4-4774-aeb1-871fa89669e1 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.380582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1129/2242] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:44.385373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a7080057434ddc80db09cf6420527b, user_id=da835147184146b58283f65db5ed6d96, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.389675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.494819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1114/2243] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:44 2022] PUT /identity/v3/projects/25a7080057434ddc80db09cf6420527b/users/da835147184146b58283f65db5ed6d96/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:44.511642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.512013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.512295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.564419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] MFA Rules not processed for user `da835147184146b58283f65db5ed6d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:44.565847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:44.668290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1130/2244] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:44.679552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.761577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c77d6b-d6db-434f-b8e3-99cf750e86bf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.766957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.767718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.768945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.768945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.769333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.771051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.876635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1115/2245] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:44 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:44.881362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.897696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a050ae-be86-4b26-9e12-023348e57cbd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.959661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.960915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.960915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.964109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.964109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.964275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.982915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:45.053005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1131/2246] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:44 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:45.058805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:45.075077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34251-cf45-4c53-ad0e-063f2252f0b2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:45.081405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:45.082218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:45.082802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:45.083226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:45.084037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:45.086464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:45.103765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1116/2247] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:45.108028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:45.120576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b259-9c32-4e4f-8e7a-1660348e878a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:45.125731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:45.126547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:45.126922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:45.127279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] PATH_INFO: `/v3/projects/33361d013f0b4b10b21f910830890305/users/c66f3b1d75964430b43a03379d27a760/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:45.145495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=33361d013f0b4b10b21f910830890305, user_id=c66f3b1d75964430b43a03379d27a760, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:45.149081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:45.269032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1132/2248] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:45 2022] PUT /identity/v3/projects/33361d013f0b4b10b21f910830890305/users/c66f3b1d75964430b43a03379d27a760/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:45.274787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:45.285820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e6ce5-01a3-4574-a974-424a447c9dc1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:45.343411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8bbc0-a468-4482-8c9d-a5373b6a6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:45.344018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8bbc0-a468-4482-8c9d-a5373b6a6ece admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:45.344297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8bbc0-a468-4482-8c9d-a5373b6a6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:45.344571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8bbc0-a468-4482-8c9d-a5373b6a6ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:45.345204 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8bbc0-a468-4482-8c9d-a5373b6a6ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:45.346833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8bbc0-a468-4482-8c9d-a5373b6a6ece admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:45.357052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1117/2249] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:45.361405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:45.372369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d450aa-a5b2-46b0-a1ea-8e1cfef57bbe admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:45.377085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:45.377741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:45.378073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:45.378353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] PATH_INFO: `/v3/projects/33361d013f0b4b10b21f910830890305/users/c66f3b1d75964430b43a03379d27a760/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:45.380346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33361d013f0b4b10b21f910830890305, user_id=c66f3b1d75964430b43a03379d27a760, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:45.383738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:45.394322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1133/2250] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:45 2022] PUT /identity/v3/projects/33361d013f0b4b10b21f910830890305/users/c66f3b1d75964430b43a03379d27a760/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:45.426149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:45.426149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:45.426149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:45.443495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] MFA Rules not processed for user `c66f3b1d75964430b43a03379d27a760`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:45.445551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:45.532009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1118/2251] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:45.548411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:45.548411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:45.614056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5cce-e13c-4aa7-b97f-401c18401683 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:45.618832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619af4bf-c1a9-46e6-8b63-229f731b5f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:45.619500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af4bf-c1a9-46e6-8b63-229f731b5f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:45.619785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af4bf-c1a9-46e6-8b63-229f731b5f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:45.620060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619af4bf-c1a9-46e6-8b63-229f731b5f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:45.629351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af4bf-c1a9-46e6-8b63-229f731b5f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:45.630864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619af4bf-c1a9-46e6-8b63-229f731b5f9c service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:45.641453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1134/2252] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:46.056365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:46.399371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:46.696963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:46.805045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:46.873286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75de08-3959-45ab-a862-00ce1e4be240 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:46.878369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:46.879050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:46.879332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:46.879602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] PATH_INFO: `/v3/users/da835147184146b58283f65db5ed6d96` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:46.880723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da835147184146b58283f65db5ed6d96)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:46.883704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:47.090291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:47.144347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da835147184146b58283f65db5ed6d96'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:47.145017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da835147184146b58283f65db5ed6d96'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:47.145632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da835147184146b58283f65db5ed6d96'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:47.153543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da835147184146b58283f65db5ed6d96'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:47.165964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da835147184146b58283f65db5ed6d96'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:47.255088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1119/2253] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:46 2022] DELETE /identity/v3/users/da835147184146b58283f65db5ed6d96 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:47.260675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:47.261425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:47.261702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:47.281522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:47.283600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:47.348888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1135/2254] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:47.359241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:47.360645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:47.429369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053796eb-9a99-4ecb-a860-68bb60a22d39 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:47.433079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:47.433694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:47.434012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:47.434288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:47.444302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:47.445798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:47.456076 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1120/2255] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:47.604250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:47.965162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:47.967875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:47.971383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:47.985091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dcc08-6707-4e2e-b5ed-0e43d67ae98b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:47.990599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:47.991864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:47.992220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:47.992581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] PATH_INFO: `/v3/projects/25a7080057434ddc80db09cf6420527b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:47.993843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a7080057434ddc80db09cf6420527b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:47.995888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:48.154074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a7080057434ddc80db09cf6420527b', 'request_id': 'req-242962dc-823b-47df-8e10-3af8e0996b35'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.159687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a7080057434ddc80db09cf6420527b', 'request_id': 'req-242962dc-823b-47df-8e10-3af8e0996b35'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.307038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a7080057434ddc80db09cf6420527b', 'request_id': 'req-242962dc-823b-47df-8e10-3af8e0996b35'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.319395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] The token cache is being invalidate because project 25a7080057434ddc80db09cf6420527b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:48.319769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.320786 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.322324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1136/2256] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:47 2022] DELETE /identity/v3/projects/25a7080057434ddc80db09cf6420527b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:48.326272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:48.336852 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c677d-99a6-4dd4-bf07-87ae402868ec service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:48.396602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:48.397499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:48.397798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:48.398110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] PATH_INFO: `/v3/users/c66f3b1d75964430b43a03379d27a760` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:48.399240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66f3b1d75964430b43a03379d27a760)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:48.401179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:48.415921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:48.695106 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66f3b1d75964430b43a03379d27a760'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.695841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66f3b1d75964430b43a03379d27a760'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.696464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66f3b1d75964430b43a03379d27a760'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.706309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66f3b1d75964430b43a03379d27a760'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.722633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d936b6fa-dd0c-408a-856c-7a9d0b809316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66f3b1d75964430b43a03379d27a760'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:48.811401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1121/2257] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:39:48 2022] DELETE /identity/v3/users/c66f3b1d75964430b43a03379d27a760 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:48.946820 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:49.039035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:49.240147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:49.243475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:49.259357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242962dc-823b-47df-8e10-3af8e0996b35 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:49.282580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:49.342153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:49.343126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.343295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.343596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] PATH_INFO: `/v3/projects/33361d013f0b4b10b21f910830890305` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.344955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33361d013f0b4b10b21f910830890305)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:49.347046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:49.392878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:49.474198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33361d013f0b4b10b21f910830890305', 'request_id': 'req-2e75756a-e9d3-42f2-8c28-428508c7016b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:49.480294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33361d013f0b4b10b21f910830890305', 'request_id': 'req-2e75756a-e9d3-42f2-8c28-428508c7016b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:49.558167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33361d013f0b4b10b21f910830890305', 'request_id': 'req-2e75756a-e9d3-42f2-8c28-428508c7016b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:49.571034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] The token cache is being invalidate because project 33361d013f0b4b10b21f910830890305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:39:49.571328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:49.572150 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2e75756a-e9d3-42f2-8c28-428508c7016b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:39:49.573646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1137/2258] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:39:49 2022] DELETE /identity/v3/projects/33361d013f0b4b10b21f910830890305 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:49.578527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.578816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.579205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.600169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:49.602170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:49.685542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1122/2259] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:49.695550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.695853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.696136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.718383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:49.720445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:49.721358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:49.732126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1138/2260] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:49.736080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:49.748345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c5df0-f812-44d7-b4b4-71b67c6ca200 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:49.753292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:49.753941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.754248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.754716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.758614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:39:49.758614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:49.758614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:49.773506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1123/2261] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:39:49.777677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:49.787945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8a5fe-167f-46f0-8cfb-025ee46eca2f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:49.805247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:49.807268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.807562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.807928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.809419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:49.812055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:49.964080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1139/2262] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:49 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:49.968522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:49.983259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9740b2b-7d72-4e03-b413-592ea32f213a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.061751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.062973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.062973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.063705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.069506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.069506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.178099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1124/2263] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:49 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:50.191182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.205884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d164-22cf-4795-aa00-1ff09916c761 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.212487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.213316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.213840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.214243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.215008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.216750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.228920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1140/2264] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:50.233010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.244024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88319cbf-804a-441d-a676-8ea87c365051 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.248595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc7d4c-1957-4c4f-9761-038a4f230ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.249203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7d4c-1957-4c4f-9761-038a4f230ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.249490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7d4c-1957-4c4f-9761-038a4f230ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.249780 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7d4c-1957-4c4f-9761-038a4f230ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.250443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc7d4c-1957-4c4f-9761-038a4f230ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.252038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc7d4c-1957-4c4f-9761-038a4f230ad8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.268038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1125/2265] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:50.269226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.279306 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d261-9dc1-4654-9389-e9dcaf058d18 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.284273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.284961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.285261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.285513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] PATH_INFO: `/v3/projects/17a9f50df9b34df5a2f4552f3f8a4801/users/811e5effd762426f8b9be99cafcb11e8/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.300986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a9f50df9b34df5a2f4552f3f8a4801, user_id=811e5effd762426f8b9be99cafcb11e8, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.305825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.318362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:50.388349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1141/2266] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:50 2022] PUT /identity/v3/projects/17a9f50df9b34df5a2f4552f3f8a4801/users/811e5effd762426f8b9be99cafcb11e8/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:50.398893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.399186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.399464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.430999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] MFA Rules not processed for user `811e5effd762426f8b9be99cafcb11e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:50.432143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:50.514579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1126/2267] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:39:50.519196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.596305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d59a0-fba0-4b52-bc89-8965ba26d479 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.602163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.602777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.603236 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.603598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.604163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.606149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.708315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1142/2268] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:39:50 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:39:50.714053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.732044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a4fe8-1da6-4ef9-af09-830bd97460a9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.810898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.811573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.811778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.812049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.812704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.814656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.922968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1127/2269] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:39:50 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:39:50.927016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.937883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684e5c4-bab0-4231-9f08-89a82c507df7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.942603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.943216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.943502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.943840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:50.945157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.946913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.958740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1143/2270] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:50.970081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:50.982844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8df99-c639-4a85-9e1c-a2782d76e68b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:50.987741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:50.988499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:50.988672 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:50.988945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] PATH_INFO: `/v3/projects/f06ae133d52941bdb092da6b69527369/users/c25267fcfd0e4e2d8183ea9db548d907/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:51.007452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06ae133d52941bdb092da6b69527369, user_id=c25267fcfd0e4e2d8183ea9db548d907, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:51.010894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:51.135459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1128/2271] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:50 2022] PUT /identity/v3/projects/f06ae133d52941bdb092da6b69527369/users/c25267fcfd0e4e2d8183ea9db548d907/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:51.139500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:51.150664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d1b5-9fe2-4a6f-950f-8adb5455a444 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:51.170008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:51.212965 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324fc29-02d2-4a7d-934d-2a48c210d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:51.213582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324fc29-02d2-4a7d-934d-2a48c210d326 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:51.214032 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324fc29-02d2-4a7d-934d-2a48c210d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:51.214214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324fc29-02d2-4a7d-934d-2a48c210d326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:51.214894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324fc29-02d2-4a7d-934d-2a48c210d326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:51.216483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324fc29-02d2-4a7d-934d-2a48c210d326 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:51.226583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1144/2272] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:51.230893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:51.241194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ba64-8f8d-40ed-8348-59cb72f60ce6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:51.247111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:51.247802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:51.248125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:51.248407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] PATH_INFO: `/v3/projects/f06ae133d52941bdb092da6b69527369/users/c25267fcfd0e4e2d8183ea9db548d907/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:51.250337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06ae133d52941bdb092da6b69527369, user_id=c25267fcfd0e4e2d8183ea9db548d907, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:51.252948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:51.265321 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1129/2273] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:39:51 2022] PUT /identity/v3/projects/f06ae133d52941bdb092da6b69527369/users/c25267fcfd0e4e2d8183ea9db548d907/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:39:51.276848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1936-ca33-49ad-8958-bd46001e4e9e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:51.277220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1936-ca33-49ad-8958-bd46001e4e9e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:51.277649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea1936-ca33-49ad-8958-bd46001e4e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:51.316355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a4ea1936-ca33-49ad-8958-bd46001e4e9e None None] MFA Rules not processed for user `c25267fcfd0e4e2d8183ea9db548d907`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:51.317726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a4ea1936-ca33-49ad-8958-bd46001e4e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:51.396099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1145/2274] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:51.407907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:51.410313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:51.411620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:51.461739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:51.472132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e5915-47e8-4b37-b384-8d98caf33a8b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:51.476478 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:51.477237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:51.477401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:51.477915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:51.540714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:51.542116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:51.552063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1130/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:51.761141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:51.787683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:52.453926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:52.454767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:52.455229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:52.483902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] MFA Rules not processed for user `3309a24e48f243b2a7d9b84adb1dd815`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:52.485412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:52.581399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:52.608629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb23a7a-921f-40c7-94f7-e9630d492b2a service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:52.608629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:52.608629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:52.608629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:52.609326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:52.609326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:52.705418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:52.707372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e72f66-7f6b-470e-b784-57736fb9846d service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:52.714666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1146/2276] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:39:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:52.718539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1131/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:52.867146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:52.962345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:53.679645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:53.740981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.238293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.286200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.660982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.684215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.763083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.815360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.837605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:54.985170 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:55.323045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:55.572001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:55.727177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:55.849025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:55.963627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:56.490178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:56.552270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:56.968645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:57.081880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:57.250574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:57.258592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:57.267253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93d38-1ab2-4fbb-a432-13685a94aa7f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:57.270883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:57.271560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:57.271791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:57.272227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:57.283716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:57.285290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:57.300102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1147/2278] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:39:57.616002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:57.860925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:58.386197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:58.426599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:58.500877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:58.884065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:58.929785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:59.546237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:59.735410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:00.024303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:00.024598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:00.028190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:00.048482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:00.051217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:00.112297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1132/2279] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:00.125729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:00.126805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:00.203160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e08cd4-8011-4b59-9efd-444c4fbc68f8 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:00.208243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ec069-ab9a-4227-86bf-238e1d2b1aff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:00.208861 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ec069-ab9a-4227-86bf-238e1d2b1aff service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:00.209277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ec069-ab9a-4227-86bf-238e1d2b1aff service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:00.209554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ec069-ab9a-4227-86bf-238e1d2b1aff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:00.219816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ec069-ab9a-4227-86bf-238e1d2b1aff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:00.221533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ec069-ab9a-4227-86bf-238e1d2b1aff service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:00.230020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1148/2280] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:40:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:40:00.677219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:01.683097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:03.056200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:05.039439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:05.136897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a633fd-98e2-4e3e-8b44-e5f45d00c4ea None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:05.142792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:05.143951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:05.144236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:05.144584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] PATH_INFO: `/v3/users/811e5effd762426f8b9be99cafcb11e8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:05.145747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=811e5effd762426f8b9be99cafcb11e8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:05.148348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:05.342004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811e5effd762426f8b9be99cafcb11e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:05.342773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811e5effd762426f8b9be99cafcb11e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:05.343532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811e5effd762426f8b9be99cafcb11e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:05.353736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811e5effd762426f8b9be99cafcb11e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:05.375966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811e5effd762426f8b9be99cafcb11e8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:05.444132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1133/2281] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:05 2022] DELETE /identity/v3/users/811e5effd762426f8b9be99cafcb11e8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:05.449690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:05.450278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:05.450278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:05.471336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:05.476661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:05.491178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:05.583443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1149/2282] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:05.594441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:05.596898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:05.626734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:05.700091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c655c-f7fb-4cfb-ac0d-1b3f4eb93dda admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:05.703997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:05.704890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:05.705107 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:05.705382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:05.718844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:05.720432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:05.733086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1134/2283] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:06.348674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:06.350413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:06.379359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e32e4-1aac-4e5d-a0a2-2387c2af4835 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:06.391730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:06.392382 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:06.392712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:06.393093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] PATH_INFO: `/v3/projects/17a9f50df9b34df5a2f4552f3f8a4801` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:06.397182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a9f50df9b34df5a2f4552f3f8a4801)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:06.400940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:06.590913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a9f50df9b34df5a2f4552f3f8a4801', 'request_id': 'req-d3efdc3d-a228-4c01-896e-36d2f82e84f5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:06.600420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a9f50df9b34df5a2f4552f3f8a4801', 'request_id': 'req-d3efdc3d-a228-4c01-896e-36d2f82e84f5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:06.694828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a9f50df9b34df5a2f4552f3f8a4801', 'request_id': 'req-d3efdc3d-a228-4c01-896e-36d2f82e84f5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:06.713334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] The token cache is being invalidate because project 17a9f50df9b34df5a2f4552f3f8a4801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:06.714013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:06.714937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:06.718859 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1150/2284] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:06 2022] DELETE /identity/v3/projects/17a9f50df9b34df5a2f4552f3f8a4801 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:06.723272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:06.742755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be64f-e4c8-41f0-a6ca-8725360c9502 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:06.825270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:06.826661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:06.826661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:06.826876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] PATH_INFO: `/v3/users/c25267fcfd0e4e2d8183ea9db548d907` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:06.828100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25267fcfd0e4e2d8183ea9db548d907)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:06.831335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:07.082495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25267fcfd0e4e2d8183ea9db548d907'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:07.083668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25267fcfd0e4e2d8183ea9db548d907'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:07.084445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25267fcfd0e4e2d8183ea9db548d907'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:07.098273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25267fcfd0e4e2d8183ea9db548d907'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:07.124401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550ab64f-4e98-4510-abbe-38d52abb8c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25267fcfd0e4e2d8183ea9db548d907'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:07.230602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1135/2285] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:06 2022] DELETE /identity/v3/users/c25267fcfd0e4e2d8183ea9db548d907 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:08.159278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:08.165620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:08.175968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efdc3d-a228-4c01-896e-36d2f82e84f5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:08.238586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:08.239718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:08.240029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:08.240309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] PATH_INFO: `/v3/projects/f06ae133d52941bdb092da6b69527369` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:08.241626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06ae133d52941bdb092da6b69527369)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:08.243712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:08.378079 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:08.387221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06ae133d52941bdb092da6b69527369', 'request_id': 'req-e53ee371-fa6a-4173-8fe0-2cf05eab9389'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:08.393999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06ae133d52941bdb092da6b69527369', 'request_id': 'req-e53ee371-fa6a-4173-8fe0-2cf05eab9389'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:08.517018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06ae133d52941bdb092da6b69527369', 'request_id': 'req-e53ee371-fa6a-4173-8fe0-2cf05eab9389'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:08.531159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] The token cache is being invalidate because project f06ae133d52941bdb092da6b69527369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:08.531462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:08.532160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e53ee371-fa6a-4173-8fe0-2cf05eab9389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:08.533887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1151/2286] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:08 2022] DELETE /identity/v3/projects/f06ae133d52941bdb092da6b69527369 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:08.540138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:08.540901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:08.540901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:08.589179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:08.589179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:08.622765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:08.678347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1136/2287] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:08.688005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:08.688005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:08.688005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:08.738067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:08.745233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:08.764072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1152/2288] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:08.768625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:08.785320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae18aa3-9d95-4dc4-a147-443eaf5f9b25 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:08.792688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:08.793381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:08.793923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:08.794285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:08.795019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:40:08.795394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:08.797094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:08.817048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1137/2289] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:40:08.820548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:08.838588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefefc99-5798-4157-9675-aca5d4c79eec None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:08.845390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:08.846270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:08.846596 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:08.846974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:08.848642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:08.851452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:08.986622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:08.992401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1153/2290] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:08 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:08.999096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fae196-2198-4715-889b-ee3151538e59 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:09.077392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:09.078112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:09.078398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:09.078704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:09.079307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:09.081388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:09.251292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1138/2291] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:08 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:09.256048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:09.280794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a6863-36df-4acc-9747-6a4ad5ca7558 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:09.296387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:09.296387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:09.296387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:09.296387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:09.296854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:09.296854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:09.310573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:09.311412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1154/2292] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:09.322410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4721c-8821-4908-8de2-5097f27fd554 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:09.327313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b01c0-db30-4437-bc6c-f75444456260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:09.327991 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b01c0-db30-4437-bc6c-f75444456260 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:09.328366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b01c0-db30-4437-bc6c-f75444456260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:09.328714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b01c0-db30-4437-bc6c-f75444456260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:09.329429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b01c0-db30-4437-bc6c-f75444456260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:09.331354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b01c0-db30-4437-bc6c-f75444456260 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:09.346530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1139/2293] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:09.353763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:09.358949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa996f-6083-4560-8145-168ccb0e1ad2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:09.363691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:09.364883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:09.365386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:09.365722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] PATH_INFO: `/v3/projects/62c60561ae3246e58867b340bdef7925/users/f87acbec3d564fa5a0796fe33eebbfab/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:09.383245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c60561ae3246e58867b340bdef7925, user_id=f87acbec3d564fa5a0796fe33eebbfab, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:09.386210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:09.535577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:09.535909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:09.536141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:09.539698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1155/2294] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:09 2022] PUT /identity/v3/projects/62c60561ae3246e58867b340bdef7925/users/f87acbec3d564fa5a0796fe33eebbfab/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:09.573095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] MFA Rules not processed for user `f87acbec3d564fa5a0796fe33eebbfab`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:09.574377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:09.659875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1140/2295] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:09.677982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:09.680509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:09.763483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c49ce-ac73-4920-8732-8fa9593b2a4d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:09.767333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2d3a7-884b-4cf8-b721-71f956269e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:09.767948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d3a7-884b-4cf8-b721-71f956269e9b service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:09.768424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d3a7-884b-4cf8-b721-71f956269e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:09.768700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d3a7-884b-4cf8-b721-71f956269e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:09.781955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d3a7-884b-4cf8-b721-71f956269e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:09.781955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d3a7-884b-4cf8-b721-71f956269e9b service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:09.791854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1156/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:17.745649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:17.776729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:17.808802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2657515-f201-46da-aa06-c1a5ff241988 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:17.813430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:17.814089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:17.814371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:17.819751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] PATH_INFO: `/v3/users/f87acbec3d564fa5a0796fe33eebbfab` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:17.819751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87acbec3d564fa5a0796fe33eebbfab)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:17.819751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:18.043618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87acbec3d564fa5a0796fe33eebbfab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:18.044282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87acbec3d564fa5a0796fe33eebbfab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:18.044972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87acbec3d564fa5a0796fe33eebbfab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:18.053013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87acbec3d564fa5a0796fe33eebbfab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:18.065958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87acbec3d564fa5a0796fe33eebbfab'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:18.157315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1141/2297] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:17 2022] DELETE /identity/v3/users/f87acbec3d564fa5a0796fe33eebbfab => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:18.162376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:18.163764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:18.164090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:18.183029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:18.184257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:18.244201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1157/2298] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:40:18.254184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:18.255694 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:18.328127 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed0828-0c6b-4c01-a66c-15d1354113b3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:18.333155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b102f-1b8e-4f98-b2db-71a9362492d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:18.333761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b102f-1b8e-4f98-b2db-71a9362492d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:18.334151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b102f-1b8e-4f98-b2db-71a9362492d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:18.335046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b102f-1b8e-4f98-b2db-71a9362492d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:18.344905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b102f-1b8e-4f98-b2db-71a9362492d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:18.346450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b102f-1b8e-4f98-b2db-71a9362492d2 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:18.359585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1142/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:18.839329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:18.841782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:18.856001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d957630-fb6c-4490-830c-c245b2afde56 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:18.861222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:18.861905 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:18.862359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:18.862631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] PATH_INFO: `/v3/projects/62c60561ae3246e58867b340bdef7925` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:18.863818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c60561ae3246e58867b340bdef7925)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:18.866932 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:18.871559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:19.025810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c60561ae3246e58867b340bdef7925', 'request_id': 'req-1e342976-9cbd-41a6-a640-c9f1b5f1d646'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.031540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c60561ae3246e58867b340bdef7925', 'request_id': 'req-1e342976-9cbd-41a6-a640-c9f1b5f1d646'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.099891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c60561ae3246e58867b340bdef7925', 'request_id': 'req-1e342976-9cbd-41a6-a640-c9f1b5f1d646'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.112601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] The token cache is being invalidate because project 62c60561ae3246e58867b340bdef7925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:19.112886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.113559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1e342976-9cbd-41a6-a640-c9f1b5f1d646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.115668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1158/2300] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:18 2022] DELETE /identity/v3/projects/62c60561ae3246e58867b340bdef7925 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:19.120608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.121436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.121627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.142943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:19.144183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:19.188719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:19.204797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1143/2301] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:19.214647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.216514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.216514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.236068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:19.237316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:19.246846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1159/2302] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:19.251334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.262717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49651b67-8450-4ce9-8a55-e0b5ca9b1efb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.274610 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.275232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.275510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.275782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.276438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:40:19.276737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.278431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.294887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1144/2303] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:40:19.299354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.310057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d2f80-7860-49c8-ab75-4291daa81354 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.319655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.319655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.319655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.319655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.320173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.320173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.356393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.358198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:19.371845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e6973-64d1-44dc-b645-1fb102072038 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.376605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.377224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.377502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.377799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] PATH_INFO: `/v3/users/1905dfbded714f4a9dc283d24f80ff38` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.379072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1905dfbded714f4a9dc283d24f80ff38)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.381316 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.412919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1160/2304] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:19 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:19.417082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.483301 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de9ca5-4286-478d-98dc-7b8b27c455df admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.488413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.489285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.489559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.489942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.490497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.493072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.544117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1905dfbded714f4a9dc283d24f80ff38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.544831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1905dfbded714f4a9dc283d24f80ff38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.545847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1905dfbded714f4a9dc283d24f80ff38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.553236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1905dfbded714f4a9dc283d24f80ff38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.567627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-22fb9ac9-5fd1-4b66-9264-0254c5835c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1905dfbded714f4a9dc283d24f80ff38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:19.596829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1161/2305] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:19 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:19.601989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.603614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:19.616223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3fc8-9cae-46bc-846e-a4228e77d55c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.621925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.622542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.622826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.623101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.623749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.625336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.635499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1162/2306] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:40:19.639767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.650371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a731a6-6fd5-4b8a-83a3-047cab4d63cb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.657360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.658423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.658919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.659413 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.660567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.664551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.671595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1145/2307] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:19 2022] DELETE /identity/v3/users/1905dfbded714f4a9dc283d24f80ff38 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:19.675768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.676133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.676410 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.680576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1163/2308] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:40:19.684553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.698147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13383d81-f731-4022-81a4-b2b3de8be37e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.700633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:19.701961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:19.730762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:19.759310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fee32-a460-4466-98bc-3fe799a33462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.760123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fee32-a460-4466-98bc-3fe799a33462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.760411 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fee32-a460-4466-98bc-3fe799a33462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.760744 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fee32-a460-4466-98bc-3fe799a33462 admin admin] PATH_INFO: `/v3/projects/e4be4d81851f4e6f8f7504522e6e8a75/users/20e7536391be4f7c98caa7af975806f7/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.765260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1146/2309] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:40:19.776412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:19.776577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fee32-a460-4466-98bc-3fe799a33462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4be4d81851f4e6f8f7504522e6e8a75, user_id=20e7536391be4f7c98caa7af975806f7, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.777919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:19.779303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fee32-a460-4466-98bc-3fe799a33462 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.847496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:19.851701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cec42b-0ede-42d3-be3f-d2dd5a3d5b15 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:19.858673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:19.859536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.859945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.860272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.860755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1164/2310] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:19 2022] PUT /identity/v3/projects/e4be4d81851f4e6f8f7504522e6e8a75/users/20e7536391be4f7c98caa7af975806f7/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:19.870674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:19.872192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:19.874817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:19.875101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:19.875417 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:19.884943 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1147/2311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:40:19.917685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] MFA Rules not processed for user `20e7536391be4f7c98caa7af975806f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:19.917685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.010623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1165/2312] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:20.015164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.026236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b37a7-18e8-4f98-9d8a-4a2075b9fe2f service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.086110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.086642 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.086922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.087192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.087843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.089726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.177412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1148/2313] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:20.182988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.194422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb25025-9aa6-4eb7-a496-b51d05c64003 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.256029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.257360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.257535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.257811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.258436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.260399 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.362374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1166/2314] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:20.363474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.367135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.380803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.397467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf399f-50fb-42e7-a3fb-b37d567530c8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.399220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08b467-ae0f-47eb-952b-a4f3dd370f5e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.407166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.407572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.408816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.409020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.409389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.409963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.410139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.410781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] PATH_INFO: `/v3/projects/0da6643f614e4ac9a7e5dbfb6df2d615` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.411231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.413336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da6643f614e4ac9a7e5dbfb6df2d615)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.414392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.417361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.435395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1167/2315] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:20.439826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.457700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04a2ab-7ec5-4687-a6e5-bb2536d64240 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.464971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.465738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.466185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.466696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.467527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.469727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.483694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1168/2316] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:40:20.487785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.498752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00c4c-7fb8-4c36-a83a-7f493ba0da96 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.503471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7fbaa-d786-4e98-8630-5a6012707f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.506880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fbaa-d786-4e98-8630-5a6012707f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.506880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fbaa-d786-4e98-8630-5a6012707f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.506880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7fbaa-d786-4e98-8630-5a6012707f35 admin admin] PATH_INFO: `/v3/projects/13a048952eb9442a9cef843ce0c2cd51/users/be09a416cdf64da192dcb93e22a87c0d/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.514459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:20.524389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7fbaa-d786-4e98-8630-5a6012707f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a048952eb9442a9cef843ce0c2cd51, user_id=be09a416cdf64da192dcb93e22a87c0d, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.529816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7fbaa-d786-4e98-8630-5a6012707f35 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.596700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1169/2317] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:20 2022] PUT /identity/v3/projects/13a048952eb9442a9cef843ce0c2cd51/users/be09a416cdf64da192dcb93e22a87c0d/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:20.596700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a489e6-c567-4b11-ad2c-1f1de45c0212 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.596700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a489e6-c567-4b11-ad2c-1f1de45c0212 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.596700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a489e6-c567-4b11-ad2c-1f1de45c0212 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.596700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1170/2318] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:40:20.607268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0231c-c075-4921-bb00-7e347a25832a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.607553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0231c-c075-4921-bb00-7e347a25832a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.607829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0231c-c075-4921-bb00-7e347a25832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.633904 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-65f0231c-c075-4921-bb00-7e347a25832a None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:20.635718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-65f0231c-c075-4921-bb00-7e347a25832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.637210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da6643f614e4ac9a7e5dbfb6df2d615', 'request_id': 'req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:20.649668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da6643f614e4ac9a7e5dbfb6df2d615', 'request_id': 'req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:20.705418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da6643f614e4ac9a7e5dbfb6df2d615', 'request_id': 'req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:20.714090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1171/2319] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:20.715380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af717a7f-f789-4360-a2a9-7be5314a51f7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.715677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af717a7f-f789-4360-a2a9-7be5314a51f7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.715951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af717a7f-f789-4360-a2a9-7be5314a51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.724232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] The token cache is being invalidate because project 0da6643f614e4ac9a7e5dbfb6df2d615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:20.724707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:20.727291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:20.732137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1149/2320] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:20 2022] DELETE /identity/v3/projects/0da6643f614e4ac9a7e5dbfb6df2d615 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:20.732137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.734069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.748704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-af717a7f-f789-4360-a2a9-7be5314a51f7 None None] MFA Rules not processed for user `be09a416cdf64da192dcb93e22a87c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:20.750008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-af717a7f-f789-4360-a2a9-7be5314a51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.795961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cdb4a-a84e-492c-9fc9-5edc79caf7e5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.799801 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.800427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.800728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.801005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.802768 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.817342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.819053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.820439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1172/2321] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:20.821839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035e636-e4a7-48a1-b4f4-0c4df58f17f4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.822278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035e636-e4a7-48a1-b4f4-0c4df58f17f4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.822708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035e636-e4a7-48a1-b4f4-0c4df58f17f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.831667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1150/2322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:20.832718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.834039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.839907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:20.846814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f035e636-e4a7-48a1-b4f4-0c4df58f17f4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:20.847928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f035e636-e4a7-48a1-b4f4-0c4df58f17f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.933988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1173/2323] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:20.934183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcdb4e-ce65-4599-995a-1ff281f4acc6 service glance] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.938357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16e288-2cd8-447e-a398-9ef5dd5a03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.939051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16e288-2cd8-447e-a398-9ef5dd5a03ad admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.939404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16e288-2cd8-447e-a398-9ef5dd5a03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.939676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.939794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16e288-2cd8-447e-a398-9ef5dd5a03ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.939963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.940244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.940791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16e288-2cd8-447e-a398-9ef5dd5a03ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.942756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16e288-2cd8-447e-a398-9ef5dd5a03ad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:20.960837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:20.962088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:20.970668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1174/2324] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:40:20.974911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:20.980170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:20.985258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64783fd6-3f1a-4808-a4a5-ab3b8118af87 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:20.990595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:20.991208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:20.991506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:20.991814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:20.992484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:40:20.992875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:20.994573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.005928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1175/2325] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:40:21.010471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.019891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbdc72-daa8-4adf-801a-e5f49a0a7fbf admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.025281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d936b-9072-4c7b-9131-4bc834096568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.025884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d936b-9072-4c7b-9131-4bc834096568 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.026188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d936b-9072-4c7b-9131-4bc834096568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.026494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d936b-9072-4c7b-9131-4bc834096568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.027118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d936b-9072-4c7b-9131-4bc834096568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.028991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d936b-9072-4c7b-9131-4bc834096568 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.050690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1151/2326] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:20 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:21.053019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6ee6-15c2-4139-8f83-17c10b2a1e3e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.053019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6ee6-15c2-4139-8f83-17c10b2a1e3e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.053019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d6ee6-15c2-4139-8f83-17c10b2a1e3e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.056429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1152/2327] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:40:21.056429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d6ee6-15c2-4139-8f83-17c10b2a1e3e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.129284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d6ee6-15c2-4139-8f83-17c10b2a1e3e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.134513 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.135166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.135497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.135874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.136641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.138963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.170299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1176/2328] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/projects => generated 397 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:21.171557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.171879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.172187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.192944 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:21.194886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.220253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1153/2329] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:21.221063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.231093 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e0ec0-355f-4778-9570-d6b7e48bfd57 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.250724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1177/2330] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:21.251659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.292158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.292670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.292948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.293220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.293842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.295779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.318479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252cbf0-0315-4cb1-b3c4-78a007d29a48 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.323914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.327095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.327095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.327095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.327095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.327513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.338363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1178/2331] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:21.339345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.341612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.354750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e650-94e7-472a-a44d-0ebeeebcf590 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.358468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.361595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.361595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.361595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.367014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.368573 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.376602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1179/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:21.378933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.384082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1154/2333] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:21.385178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.393388 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db8cb-8f15-4615-a420-e1a584f89c0e service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.395357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6fe00-9941-44ef-85c9-78ca19920491 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.398889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c611bf0-a194-4c0d-b3f5-c762dcfd0e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.399551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611bf0-a194-4c0d-b3f5-c762dcfd0e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.401971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611bf0-a194-4c0d-b3f5-c762dcfd0e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.401971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611bf0-a194-4c0d-b3f5-c762dcfd0e1c admin admin] PATH_INFO: `/v3/projects/59454f846cbf420785a585c7a3d50f95/users/34e016ef205c43d8b5bb1e76d0886b2a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.402174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.402174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.402174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.402174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.402718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.404305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.405802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:21.419056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1155/2334] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:40:21.419274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c611bf0-a194-4c0d-b3f5-c762dcfd0e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59454f846cbf420785a585c7a3d50f95, user_id=34e016ef205c43d8b5bb1e76d0886b2a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.419274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c611bf0-a194-4c0d-b3f5-c762dcfd0e1c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.420138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.430512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d568f3-024b-4182-bf2f-12e3a7bb542c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.436638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.436638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.436638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.436638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.437209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.438892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.451001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1156/2335] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:21.455144 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.466807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fde60-2a2c-41b7-938f-2c07dcf3ffb1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.471553 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.472238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.472520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.472800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] PATH_INFO: `/v3/projects/b2150e698b6d4dc797c6236c85ab910a/users/721406bdb4ad45bc9f697f6eaaf67e12/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.484466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1180/2336] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:21 2022] PUT /identity/v3/projects/59454f846cbf420785a585c7a3d50f95/users/34e016ef205c43d8b5bb1e76d0886b2a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:21.486178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1ecd-7633-4829-8099-ab956a26d800 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.486862 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1ecd-7633-4829-8099-ab956a26d800 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.487250 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1ecd-7633-4829-8099-ab956a26d800 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.488597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1181/2337] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:40:21.489791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f1ecd-7633-4829-8099-ab956a26d800 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.492492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2150e698b6d4dc797c6236c85ab910a, user_id=721406bdb4ad45bc9f697f6eaaf67e12, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.495149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.531340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:21.555193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f1ecd-7633-4829-8099-ab956a26d800 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.559939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72840051-f271-4ce7-b4e6-b537723fcb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.560549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72840051-f271-4ce7-b4e6-b537723fcb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.560838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72840051-f271-4ce7-b4e6-b537723fcb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.561112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72840051-f271-4ce7-b4e6-b537723fcb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.561758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72840051-f271-4ce7-b4e6-b537723fcb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.563389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72840051-f271-4ce7-b4e6-b537723fcb6f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.575285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1182/2338] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:21.576257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1157/2339] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:21 2022] PUT /identity/v3/projects/b2150e698b6d4dc797c6236c85ab910a/users/721406bdb4ad45bc9f697f6eaaf67e12/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:21.576561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843d38-57bd-4ad4-8b5b-4af4f97f41ee None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.576910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843d38-57bd-4ad4-8b5b-4af4f97f41ee None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.577197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f843d38-57bd-4ad4-8b5b-4af4f97f41ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.585125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.597134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2f843d38-57bd-4ad4-8b5b-4af4f97f41ee None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:21.598381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2f843d38-57bd-4ad4-8b5b-4af4f97f41ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.671033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2cc81-6816-4d21-b8af-0766051bf1a1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.676221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.677075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.677509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.678551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] PATH_INFO: `/v3/projects/59454f846cbf420785a585c7a3d50f95/users/34e016ef205c43d8b5bb1e76d0886b2a/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.678919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1183/2340] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:21.680281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59764c2-1be4-46c8-9940-b7056cb85bf6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.680577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59764c2-1be4-46c8-9940-b7056cb85bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.680855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59764c2-1be4-46c8-9940-b7056cb85bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.681910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59454f846cbf420785a585c7a3d50f95, user_id=34e016ef205c43d8b5bb1e76d0886b2a, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.685639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.709308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1158/2341] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:21 2022] PUT /identity/v3/projects/59454f846cbf420785a585c7a3d50f95/users/34e016ef205c43d8b5bb1e76d0886b2a/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:21.709308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.711012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.722254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e59764c2-1be4-46c8-9940-b7056cb85bf6 None None] MFA Rules not processed for user `721406bdb4ad45bc9f697f6eaaf67e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:21.723475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e59764c2-1be4-46c8-9940-b7056cb85bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.777685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518d4f-63e8-40c2-887d-9a40bd1af773 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.782234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.783033 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.783414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.783893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.802251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1184/2342] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:21.806047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.806047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.806047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.834713 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] MFA Rules not processed for user `34e016ef205c43d8b5bb1e76d0886b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:21.835948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.878744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:21.879617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:21.881969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.883673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.894654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1159/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:21.898256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.898256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.908612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1185/2344] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:21.920468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:21.922856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:21.962082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e166f-941a-4497-9331-12da51fe906d service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.966343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029c992-bc73-4907-ad94-9c74e2b0fb89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.966957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029c992-bc73-4907-ad94-9c74e2b0fb89 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.967235 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029c992-bc73-4907-ad94-9c74e2b0fb89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.967529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029c992-bc73-4907-ad94-9c74e2b0fb89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.978148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029c992-bc73-4907-ad94-9c74e2b0fb89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:21.979853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029c992-bc73-4907-ad94-9c74e2b0fb89 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:21.986549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200eb39-a867-48a2-a1a1-c982547f55a0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:21.991446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1160/2345] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:21.991565 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:21.992156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:21.992577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:21.992887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:21.994760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:22.081640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:22.081640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a39e4-44bf-4cb2-9b23-15730131687e service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:22.102933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1186/2346] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:40:22.767406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53502f-abac-4c2d-b145-391544c16172 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:22.767967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53502f-abac-4c2d-b145-391544c16172 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:22.767967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53502f-abac-4c2d-b145-391544c16172 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:22.769482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1161/2347] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:40:22.782020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:22.782464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:22.782847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:22.804095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] MFA Rules not processed for user `1ae3f2f0b014430e8fb19ad7316b75c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:22.805690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:22.914018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1187/2348] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:22.924808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53502f-abac-4c2d-b145-391544c16172 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:22.926901 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ab53502f-abac-4c2d-b145-391544c16172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:22.947195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53502f-abac-4c2d-b145-391544c16172 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:22.953065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:22.953724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:22.954075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:22.954396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:22.968100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:22.969749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:23.012678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1162/2349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:23.736979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:23.738434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:23.777059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:23.811514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d323eb8-a9c5-4dda-876c-fce794968ee9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:23.816277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:23.816911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:23.817818 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:23.818198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] PATH_INFO: `/v3/users/1dcb2564e9134fa1a31bcb5a637d0623` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:23.823455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dcb2564e9134fa1a31bcb5a637d0623)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:23.825401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:23.996692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dcb2564e9134fa1a31bcb5a637d0623'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.059806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dcb2564e9134fa1a31bcb5a637d0623'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.060442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dcb2564e9134fa1a31bcb5a637d0623'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.074214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dcb2564e9134fa1a31bcb5a637d0623'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.075016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dcb2564e9134fa1a31bcb5a637d0623'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.089469 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1188/2350] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:23 2022] DELETE /identity/v3/users/1dcb2564e9134fa1a31bcb5a637d0623 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:24.380817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:24.394116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327a565-980e-4edf-8024-3560319e29ee service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:24.478147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:24.478782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:24.479065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:24.479341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] PATH_INFO: `/v3/projects/af766459c85543e2a4b4e09de319bb27` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:24.480509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=af766459c85543e2a4b4e09de319bb27)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:24.482487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:24.586608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af766459c85543e2a4b4e09de319bb27', 'request_id': 'req-75a08207-727d-414e-b820-442caa8daddc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.592873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af766459c85543e2a4b4e09de319bb27', 'request_id': 'req-75a08207-727d-414e-b820-442caa8daddc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.654025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af766459c85543e2a4b4e09de319bb27', 'request_id': 'req-75a08207-727d-414e-b820-442caa8daddc'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.666250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] The token cache is being invalidate because project af766459c85543e2a4b4e09de319bb27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:24.666887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.667171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.668667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1163/2351] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:24 2022] DELETE /identity/v3/projects/af766459c85543e2a4b4e09de319bb27 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:24.672970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:24.674391 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:24.689492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3b79-6145-4671-a53f-d5b13a9f0edf admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:24.748614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:24.749259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:24.749532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:24.749805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] PATH_INFO: `/v3/users/536487cebc364b26b2ab55d10aa666f3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:24.751071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536487cebc364b26b2ab55d10aa666f3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:24.753044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:24.930246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536487cebc364b26b2ab55d10aa666f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.930953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:24.996735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536487cebc364b26b2ab55d10aa666f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:24.997464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536487cebc364b26b2ab55d10aa666f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.012945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536487cebc364b26b2ab55d10aa666f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.013794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536487cebc364b26b2ab55d10aa666f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.047145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1189/2352] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:24 2022] DELETE /identity/v3/users/536487cebc364b26b2ab55d10aa666f3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:25.170305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:25.173744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:25.197017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:25.244283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a08207-727d-414e-b820-442caa8daddc admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:25.303306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:25.303962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:25.304848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:25.304848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:25.306764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:25.332341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:25.333788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:25.385240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:25.386781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a6757-0a5e-4638-95e7-dea81354cd81 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:25.400140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1164/2353] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:25.423378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c153-0bfc-44fb-8786-4a723dab8bd6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:25.429147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:25.431716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:25.431716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:25.431716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] PATH_INFO: `/v3/projects/76ca1ad399644000b2fd2cf32e8712f3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:25.433060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ca1ad399644000b2fd2cf32e8712f3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:25.438362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:25.567821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ca1ad399644000b2fd2cf32e8712f3', 'request_id': 'req-205d0a0b-01c8-4241-816f-81b56bfc6fa3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.575016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ca1ad399644000b2fd2cf32e8712f3', 'request_id': 'req-205d0a0b-01c8-4241-816f-81b56bfc6fa3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.654188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ca1ad399644000b2fd2cf32e8712f3', 'request_id': 'req-205d0a0b-01c8-4241-816f-81b56bfc6fa3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.667001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] The token cache is being invalidate because project 76ca1ad399644000b2fd2cf32e8712f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:25.667291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.667886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-205d0a0b-01c8-4241-816f-81b56bfc6fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:25.672844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1190/2354] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:25 2022] DELETE /identity/v3/projects/76ca1ad399644000b2fd2cf32e8712f3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:25.678654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:25.678654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:25.678654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:25.698566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:25.699959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:25.778871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1165/2355] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:25.787943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:25.788341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:25.788615 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:25.808622 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:25.809959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:25.820964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1191/2356] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:25.822578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:25.832691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d0f60-282a-4881-ae09-f99a17de66bd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:25.837527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:25.838167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:25.838447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:25.838716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:25.839361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:40:25.839663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:25.841301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:25.854088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1166/2357] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:40:25.858531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:25.868559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db87d5-9a5c-4125-bd89-7cc4d62471d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:25.873745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ebd8f-3ebc-44af-b335-c5df2fe63c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:25.874443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ebd8f-3ebc-44af-b335-c5df2fe63c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:25.874731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ebd8f-3ebc-44af-b335-c5df2fe63c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:25.875006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ebd8f-3ebc-44af-b335-c5df2fe63c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:25.875643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ebd8f-3ebc-44af-b335-c5df2fe63c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:25.877619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ebd8f-3ebc-44af-b335-c5df2fe63c89 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.000169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1192/2358] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:25 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:26.004434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.015130 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746f59-db1a-48bd-a133-31de7905192d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.026273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:26.076099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.076762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.077032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.077308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.077978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.079895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.162942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.163906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.163906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.184008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:26.185231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:26.204354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1167/2359] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:26 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:26.205441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.216926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b596b61-ac8c-4fe2-bbf0-2815f9222433 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.220450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:26.222414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.223022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.223300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.223570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.224215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.226793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.243626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1168/2360] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:40:26.245306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.256179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeea159-6f6b-42a1-900e-c530064ad88b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.256369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1193/2361] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:40:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:26.261241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.261956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.262236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.268172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.268172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.268172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.269616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.271109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:26.279905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1169/2362] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:26.281211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.292669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466612f-d85c-4dfd-b9b9-f0f43246c709 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.297828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.298742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.302547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.302547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] PATH_INFO: `/v3/projects/bb6a5a4b72574e049e0c77a18d01818e/users/54efbac79bd5412b934ebd19c067cbb8/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.314651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6a5a4b72574e049e0c77a18d01818e, user_id=54efbac79bd5412b934ebd19c067cbb8, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.317397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.347112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c975e23-15db-4ff9-884d-bc30f01d351d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.354349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820a0d-e615-4ac9-93b1-bf16aa177318 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.354967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820a0d-e615-4ac9-93b1-bf16aa177318 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.359829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820a0d-e615-4ac9-93b1-bf16aa177318 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.359829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820a0d-e615-4ac9-93b1-bf16aa177318 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.364799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820a0d-e615-4ac9-93b1-bf16aa177318 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.366494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820a0d-e615-4ac9-93b1-bf16aa177318 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.374885 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1194/2363] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:40:26.400819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1170/2364] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:26 2022] PUT /identity/v3/projects/bb6a5a4b72574e049e0c77a18d01818e/users/54efbac79bd5412b934ebd19c067cbb8/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:26.411082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.411375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.411656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.441024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] MFA Rules not processed for user `54efbac79bd5412b934ebd19c067cbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:26.442206 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:26.517004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1195/2365] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:26.531044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.533043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:26.648399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7988-1aec-4e0c-8f07-8bfbdbe35938 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.656577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.657212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.657499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.657779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.669584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.671068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:26.681612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1171/2366] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:26.725130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:26.811419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:26.843954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f470f36-99d8-45cc-b598-51a42d43bc1a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:26.850710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:26.851503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:26.852011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:26.852390 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] PATH_INFO: `/v3/users/54efbac79bd5412b934ebd19c067cbb8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:26.854086 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54efbac79bd5412b934ebd19c067cbb8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:26.856492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:27.115929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:27.117502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:27.135500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf369dde-4f16-49fa-abf7-7f742cfe9187 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:27.140167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:27.141179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:27.141557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:27.142084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:27.144419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:27.161335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54efbac79bd5412b934ebd19c067cbb8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:27.226494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54efbac79bd5412b934ebd19c067cbb8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:27.227803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54efbac79bd5412b934ebd19c067cbb8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:27.249274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54efbac79bd5412b934ebd19c067cbb8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:27.250247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-61447588-068b-4f4f-87ab-693f5319513f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54efbac79bd5412b934ebd19c067cbb8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:27.268245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:27.274226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:27.275878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:27.287658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1196/2367] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:26 2022] DELETE /identity/v3/users/54efbac79bd5412b934ebd19c067cbb8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:27.289082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:27.289377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:27.289717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:27.301071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1172/2368] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:27.312113 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:27.313502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:27.394823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1197/2369] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:27.405653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:27.407378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:27.486552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475230-bc50-472b-805f-edc97fccc9dc service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:27.570961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b854e5-43bb-469e-a0a1-2252a6e68154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:27.571920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b854e5-43bb-469e-a0a1-2252a6e68154 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:27.572578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b854e5-43bb-469e-a0a1-2252a6e68154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:27.572847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b854e5-43bb-469e-a0a1-2252a6e68154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:27.587039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b854e5-43bb-469e-a0a1-2252a6e68154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:27.588506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b854e5-43bb-469e-a0a1-2252a6e68154 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:27.600935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1173/2370] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:28.148495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:28.151314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:28.191854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b758208-107c-42b7-861f-0981f2fcffe6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:28.205518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:28.206467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:28.206749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:28.207479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] PATH_INFO: `/v3/projects/bb6a5a4b72574e049e0c77a18d01818e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:28.208915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6a5a4b72574e049e0c77a18d01818e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:28.213407 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:28.397262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6a5a4b72574e049e0c77a18d01818e', 'request_id': 'req-d02f3dec-415d-482b-8945-1052a7241862'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:28.411597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6a5a4b72574e049e0c77a18d01818e', 'request_id': 'req-d02f3dec-415d-482b-8945-1052a7241862'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:28.476432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6a5a4b72574e049e0c77a18d01818e', 'request_id': 'req-d02f3dec-415d-482b-8945-1052a7241862'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:28.478775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:28.488253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] The token cache is being invalidate because project bb6a5a4b72574e049e0c77a18d01818e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:28.488540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:28.489423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d02f3dec-415d-482b-8945-1052a7241862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:28.491867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1198/2371] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:28 2022] DELETE /identity/v3/projects/bb6a5a4b72574e049e0c77a18d01818e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:28.497725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:28.498288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:28.498384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:28.519986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:28.521236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:28.593062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1174/2372] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:28.601095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:28.601520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:28.601520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:28.646073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:28.647490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:28.668089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1199/2373] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:28.673494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:28.684987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b4d14-eef7-42ef-add4-b898bbbb7385 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:28.690423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:28.691065 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:28.691337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:28.691639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:28.692373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:40:28.692862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:28.695952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:28.711789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1175/2374] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:40:28.716094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:28.728058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb1fa2-50d1-48b4-a32e-40bce19ef4a3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:28.739269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:28.743507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:28.743799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:28.744080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:28.744805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:28.752144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:28.866046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1200/2375] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:28 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:28.867725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:28.878213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8fe8-95b6-4dfc-b08c-4d74b966868c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:28.937810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:28.960857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:28.961900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:28.961900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:28.962150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:28.962701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:28.964605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:29.081638 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1176/2376] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:28 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:29.083235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:29.096947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47941ea7-d14a-47e1-bf6e-b6d47489d3be admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:29.102972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:29.103730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:29.104291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:29.105671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:29.105671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:29.107249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:29.120535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1201/2377] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:29.126996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:29.135639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac76091-463e-4082-934f-8f48c9b9dfc5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:29.140558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e609ef-c605-496f-82c4-95c3fa10afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:29.141171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e609ef-c605-496f-82c4-95c3fa10afcf admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:29.141452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e609ef-c605-496f-82c4-95c3fa10afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:29.141725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e609ef-c605-496f-82c4-95c3fa10afcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:29.142395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e609ef-c605-496f-82c4-95c3fa10afcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:29.144134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e609ef-c605-496f-82c4-95c3fa10afcf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:29.159382 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1177/2378] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:29.160564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:29.172103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9aa9-4b34-4336-a9e7-43d894d9c5e6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:29.187579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:29.188335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:29.188544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:29.188816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] PATH_INFO: `/v3/projects/c632259afb624d80a1e7efed4eb4348b/users/fc7e4139db574e40b9b7c6188489d2dd/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:29.207604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c632259afb624d80a1e7efed4eb4348b, user_id=fc7e4139db574e40b9b7c6188489d2dd, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:29.210867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:29.307477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1202/2379] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:29 2022] PUT /identity/v3/projects/c632259afb624d80a1e7efed4eb4348b/users/fc7e4139db574e40b9b7c6188489d2dd/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:29.313115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:29.313432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:29.313712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:29.333849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:29.335164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:29.450741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1178/2380] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:29.457338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:29.459682 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:29.510925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:29.512789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:29.531227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79447465-08f6-49dd-9f92-9fd43da91485 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:29.536541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:29.538569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:29.538855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:29.539131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] PATH_INFO: `/v3/users/721406bdb4ad45bc9f697f6eaaf67e12` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:29.540401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721406bdb4ad45bc9f697f6eaaf67e12)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:29.543215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:29.632005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93986e0a-b449-4f01-a26f-b730eb298a2f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:29.635945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ecb85-e643-4334-9203-ab89879e8d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:29.636556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ecb85-e643-4334-9203-ab89879e8d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:29.636833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ecb85-e643-4334-9203-ab89879e8d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:29.640330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ecb85-e643-4334-9203-ab89879e8d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:29.654038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ecb85-e643-4334-9203-ab89879e8d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:29.655479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ecb85-e643-4334-9203-ab89879e8d78 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:29.667184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1203/2381] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:30.431189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721406bdb4ad45bc9f697f6eaaf67e12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:30.438937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721406bdb4ad45bc9f697f6eaaf67e12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:30.438937 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721406bdb4ad45bc9f697f6eaaf67e12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:30.444097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721406bdb4ad45bc9f697f6eaaf67e12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:30.461246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721406bdb4ad45bc9f697f6eaaf67e12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:30.551606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1179/2382] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:29 2022] DELETE /identity/v3/users/721406bdb4ad45bc9f697f6eaaf67e12 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:30.572630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:30.572630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:30.572630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:30.587147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:30.588694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:30.669278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1204/2383] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:30.681295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:30.683083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:30.748856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:30.810999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eedbf-d12d-4e91-859a-356874e4f150 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:30.828485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:30.828485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:30.828723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:30.828896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:30.856823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:30.859934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:30.881739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1180/2384] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:31.476175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:31.478255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:31.525040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca346b4-ef80-433a-bd3b-ac9ed275881a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:31.542021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:31.542813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:31.543182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:31.543571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] PATH_INFO: `/v3/projects/b2150e698b6d4dc797c6236c85ab910a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:31.544907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2150e698b6d4dc797c6236c85ab910a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:31.557142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:32.074008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:32.107807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2150e698b6d4dc797c6236c85ab910a', 'request_id': 'req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:32.115869 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2150e698b6d4dc797c6236c85ab910a', 'request_id': 'req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:32.215339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2150e698b6d4dc797c6236c85ab910a', 'request_id': 'req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:32.244831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] The token cache is being invalidate because project b2150e698b6d4dc797c6236c85ab910a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:32.245130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:32.254603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-cdab46a0-fee0-4f6c-a61c-193aa141dbbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:32.257238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1205/2385] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:31 2022] DELETE /identity/v3/projects/b2150e698b6d4dc797c6236c85ab910a => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:33.902520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:33.904038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:33.930133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339a807-cd4c-4d97-b701-990dc42f95fa service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:34.101311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:34.102368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:34.102834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:34.103305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] PATH_INFO: `/v3/users/20e7536391be4f7c98caa7af975806f7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:34.106255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e7536391be4f7c98caa7af975806f7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:34.110013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:34.321147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e7536391be4f7c98caa7af975806f7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:34.321942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e7536391be4f7c98caa7af975806f7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:34.322630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e7536391be4f7c98caa7af975806f7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:34.335621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e7536391be4f7c98caa7af975806f7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:34.373639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e7536391be4f7c98caa7af975806f7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:34.466982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1181/2386] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:33 2022] DELETE /identity/v3/users/20e7536391be4f7c98caa7af975806f7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:34.471278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:34.472167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:34.472454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:34.508787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:34.511701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:34.628098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1206/2387] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:34.640945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:34.641408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:34.750219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cc6da-a432-4e5f-86a1-bd340f24cfc9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:34.755167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:34.756209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:34.756906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:34.757190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:34.767113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:34.768568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:34.773486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:34.786692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1182/2388] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:35.771866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:35.775325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:35.799225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca49e7-e4d7-4b49-bac6-b0e8e5f3368b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:35.807370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:35.812864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:35.812864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:35.812864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] PATH_INFO: `/v3/projects/e4be4d81851f4e6f8f7504522e6e8a75` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:35.812864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4be4d81851f4e6f8f7504522e6e8a75)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:35.814755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:35.982546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4be4d81851f4e6f8f7504522e6e8a75', 'request_id': 'req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:35.992471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4be4d81851f4e6f8f7504522e6e8a75', 'request_id': 'req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.104451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4be4d81851f4e6f8f7504522e6e8a75', 'request_id': 'req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.120473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] The token cache is being invalidate because project e4be4d81851f4e6f8f7504522e6e8a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:36.120828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.121435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.123369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1207/2389] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:35 2022] DELETE /identity/v3/projects/e4be4d81851f4e6f8f7504522e6e8a75 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:36.127281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:36.138435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461416df-164f-4ccc-8854-c2daaf9b0daa service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:36.223834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:36.225836 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:36.226342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:36.226620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] PATH_INFO: `/v3/users/be09a416cdf64da192dcb93e22a87c0d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:36.228337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=be09a416cdf64da192dcb93e22a87c0d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:36.230303 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:36.500326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be09a416cdf64da192dcb93e22a87c0d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.501038 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be09a416cdf64da192dcb93e22a87c0d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.501767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be09a416cdf64da192dcb93e22a87c0d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.513591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be09a416cdf64da192dcb93e22a87c0d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.532880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be09a416cdf64da192dcb93e22a87c0d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:36.676135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1183/2390] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:36 2022] DELETE /identity/v3/users/be09a416cdf64da192dcb93e22a87c0d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:37.177552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:37.179827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:37.211912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cfde-1652-4ac3-ab3b-a1b9f7e1a8c8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:37.308856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:37.339917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:37.340624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:37.340921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:37.341186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] PATH_INFO: `/v3/projects/13a048952eb9442a9cef843ce0c2cd51` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:37.343059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a048952eb9442a9cef843ce0c2cd51)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:37.345675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:37.479705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a048952eb9442a9cef843ce0c2cd51', 'request_id': 'req-e5337de1-1015-4d95-92b9-d83df7e26216'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:37.491751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a048952eb9442a9cef843ce0c2cd51', 'request_id': 'req-e5337de1-1015-4d95-92b9-d83df7e26216'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:37.591539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a048952eb9442a9cef843ce0c2cd51', 'request_id': 'req-e5337de1-1015-4d95-92b9-d83df7e26216'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:37.608887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] The token cache is being invalidate because project 13a048952eb9442a9cef843ce0c2cd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:37.609300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:37.610055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e5337de1-1015-4d95-92b9-d83df7e26216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:37.617175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1208/2391] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:37 2022] DELETE /identity/v3/projects/13a048952eb9442a9cef843ce0c2cd51 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:37.618603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:37.625612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:37.644504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8881714-ae23-43fe-ac92-cbb9231e55aa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:37.807115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:37.810341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:37.810341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:37.810341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] PATH_INFO: `/v3/users/34e016ef205c43d8b5bb1e76d0886b2a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:37.817624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e016ef205c43d8b5bb1e76d0886b2a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:37.824113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:37.861770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:38.031653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.031949 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.032229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.071671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] MFA Rules not processed for user `fc7e4139db574e40b9b7c6188489d2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:38.072922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:38.099804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e016ef205c43d8b5bb1e76d0886b2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:38.100747 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e016ef205c43d8b5bb1e76d0886b2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:38.102486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e016ef205c43d8b5bb1e76d0886b2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:38.117572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e016ef205c43d8b5bb1e76d0886b2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:38.131463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e016ef205c43d8b5bb1e76d0886b2a'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:38.156248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1209/2392] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:40:38.160897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.162977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:38.177482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4adf37-c535-4bbe-a96b-db55bc3fb602 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.183896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.188218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.188218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.188218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.188218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.188218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.215036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1184/2393] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:40:37 2022] DELETE /identity/v3/users/34e016ef205c43d8b5bb1e76d0886b2a => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:38.313495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1210/2394] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:38 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:40:38.314393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.386088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea727368-61fb-4f0b-a210-68ab0306f6da admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.451957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.452580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.453139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.453325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.454073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.456239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.579252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1185/2395] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:38 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:38.582819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.594586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aade1-e5f5-406f-b7c7-c8444bd58a57 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.601809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.602580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.602926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.603270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.603992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.605718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.618169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1211/2396] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:38.622121 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.642760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286643ff-3ffc-45ef-8393-cd38ca368a7e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.649186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.649895 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.650168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.650441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] PATH_INFO: `/v3/projects/83dbdd9eaed04e30bd12e9e108fdb024/users/1e83c6e37a8c4c7cb03de560139755fa/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.676441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dbdd9eaed04e30bd12e9e108fdb024, user_id=1e83c6e37a8c4c7cb03de560139755fa, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.684046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.732518 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.734336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:38.750259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfb1dd-0ee0-4ddd-abc7-7199f81c9696 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.754992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.755649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.755937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.756212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] PATH_INFO: `/v3/projects/59454f846cbf420785a585c7a3d50f95` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.757345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59454f846cbf420785a585c7a3d50f95)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.759344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.778133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1186/2397] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:38 2022] PUT /identity/v3/projects/83dbdd9eaed04e30bd12e9e108fdb024/users/1e83c6e37a8c4c7cb03de560139755fa/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:38.782921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.794357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:38.846804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3f19b-d5c3-4045-b2b2-7909926b2899 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.851531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.852138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.852451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.852719 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.853366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.854997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.865368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1187/2398] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:38.869602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:38.879249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e12aa5-7dd2-4e62-bba8-1786fb57e407 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:38.887354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9df72-c775-4b24-941a-3b4519b1d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:38.891687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9df72-c775-4b24-941a-3b4519b1d47c admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:38.891687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9df72-c775-4b24-941a-3b4519b1d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:38.891687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9df72-c775-4b24-941a-3b4519b1d47c admin admin] PATH_INFO: `/v3/projects/83dbdd9eaed04e30bd12e9e108fdb024/users/1e83c6e37a8c4c7cb03de560139755fa/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:38.891687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9df72-c775-4b24-941a-3b4519b1d47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83dbdd9eaed04e30bd12e9e108fdb024, user_id=1e83c6e37a8c4c7cb03de560139755fa, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:38.893877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9df72-c775-4b24-941a-3b4519b1d47c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:38.906001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59454f846cbf420785a585c7a3d50f95', 'request_id': 'req-863aee39-5e2a-4648-bb06-6322d8df55f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:38.907450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1188/2399] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:38 2022] PUT /identity/v3/projects/83dbdd9eaed04e30bd12e9e108fdb024/users/1e83c6e37a8c4c7cb03de560139755fa/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:38.920359 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59454f846cbf420785a585c7a3d50f95', 'request_id': 'req-863aee39-5e2a-4648-bb06-6322d8df55f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:39.002156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59454f846cbf420785a585c7a3d50f95', 'request_id': 'req-863aee39-5e2a-4648-bb06-6322d8df55f3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:39.015164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] The token cache is being invalidate because project 59454f846cbf420785a585c7a3d50f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:40:39.015452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:39.016103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-863aee39-5e2a-4648-bb06-6322d8df55f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:40:39.017580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1212/2400] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:40:38 2022] DELETE /identity/v3/projects/59454f846cbf420785a585c7a3d50f95 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:40:39.023519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.023939 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.024224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.044950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:39.046206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:39.131950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1189/2401] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:39.132125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.132125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.132367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.154071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:39.160362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:39.163403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1213/2402] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:39.167876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.177982 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279a96-4004-451b-ae47-08384e4b9548 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:39.182715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:39.183546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.183690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.183887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.184653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:40:39.184959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:39.186661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:39.199644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1190/2403] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:40:39.204096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.214315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:39.214832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abd563-9b15-4500-a19d-ba396fb8b3eb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:39.219875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:39.220484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.220764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.221062 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.221688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:39.223701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:39.366332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1214/2404] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:40:39 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:39.366539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.376447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864d4a3-ad1a-4301-a848-325ab01d9ea3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:39.438548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:39.439238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.439587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.439924 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.440740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:39.442989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:39.547467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1191/2405] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:40:39 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:40:39.554100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.570501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe2d4-aee2-40d5-9419-329cced38853 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:39.576534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:39.577505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.577922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.578300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.579061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:39.585575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:39.609544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1215/2406] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:39.610814 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.627867 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2b75-2e72-42ac-99d5-b96244114d2e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:39.637934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dd9f7-703a-4857-a54e-d6d79b225bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:39.638051 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd9f7-703a-4857-a54e-d6d79b225bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.638411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd9f7-703a-4857-a54e-d6d79b225bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.638612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dd9f7-703a-4857-a54e-d6d79b225bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.639581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dd9f7-703a-4857-a54e-d6d79b225bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:39.641056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3dd9f7-703a-4857-a54e-d6d79b225bf9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:39.652997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1192/2407] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:40:39.657002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.668403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7550-7697-4f31-9cf5-56919d94fd45 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:39.673292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:39.673996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.674347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.674630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] PATH_INFO: `/v3/projects/be535a0b328b42f1a22831fe134e7f74/users/50806523a01f4306a729e49b6f8af4b5/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.693083 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be535a0b328b42f1a22831fe134e7f74, user_id=50806523a01f4306a729e49b6f8af4b5, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:39.695902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:39.803167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1216/2408] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:40:39 2022] PUT /identity/v3/projects/be535a0b328b42f1a22831fe134e7f74/users/50806523a01f4306a729e49b6f8af4b5/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:40:39.808301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00da96-a652-4d50-95a9-106351eed7a0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:39.808979 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00da96-a652-4d50-95a9-106351eed7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:39.809632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00da96-a652-4d50-95a9-106351eed7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:39.813782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:39.851158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dc00da96-a652-4d50-95a9-106351eed7a0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:39.851635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dc00da96-a652-4d50-95a9-106351eed7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:39.965156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1193/2409] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:39.970961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:39.972921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:40.039541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05f09-188b-4c1a-8ef2-cee9a6e76665 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:40.046642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:40.046642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:40.046642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:40.046642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:40.054688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:40.056496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:40.068598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1217/2410] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:41.756770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7e4e-560f-4000-985b-63ca7488e1a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:41.757285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7e4e-560f-4000-985b-63ca7488e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:41.757922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7e4e-560f-4000-985b-63ca7488e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:41.804661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7a7e7e4e-560f-4000-985b-63ca7488e1a6 None None] MFA Rules not processed for user `50806523a01f4306a729e49b6f8af4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:41.806244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7a7e7e4e-560f-4000-985b-63ca7488e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:41.996595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1194/2411] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:42.010613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:42.012247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:42.126794 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f455f-38ff-4a9b-947b-c1676909cc18 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:42.135067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe179c-a80e-4ff3-a167-89f4400692f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:42.136029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe179c-a80e-4ff3-a167-89f4400692f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:42.136734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe179c-a80e-4ff3-a167-89f4400692f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:42.137173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe179c-a80e-4ff3-a167-89f4400692f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:42.151720 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:42.159537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe179c-a80e-4ff3-a167-89f4400692f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:42.163629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe179c-a80e-4ff3-a167-89f4400692f2 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:42.177202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1218/2412] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:44.030244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76148-0206-476d-96c6-4aa8393eca20 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:44.030721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76148-0206-476d-96c6-4aa8393eca20 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:44.030827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d76148-0206-476d-96c6-4aa8393eca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:44.042467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:44.043036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:44.043036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:44.055969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-45d76148-0206-476d-96c6-4aa8393eca20 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:44.057782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45d76148-0206-476d-96c6-4aa8393eca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:44.064027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] MFA Rules not processed for user `50806523a01f4306a729e49b6f8af4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:44.065431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:44.079043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1219/2413] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:40:44.142013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1195/2414] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 24 09:40:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:44.173527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:44.175377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:44.280099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62af21-d5b5-4757-a88f-0eee05564418 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:44.293620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:44.294524 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:44.294963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:44.295379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:44.307488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:44.309635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:44.321952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1220/2415] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:40:45.498447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54477468-8f41-44bd-a67b-b545817aeb84 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:45.498920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54477468-8f41-44bd-a67b-b545817aeb84 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:45.499078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54477468-8f41-44bd-a67b-b545817aeb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:45.570909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-54477468-8f41-44bd-a67b-b545817aeb84 None None] MFA Rules not processed for user `1e83c6e37a8c4c7cb03de560139755fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:45.572337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-54477468-8f41-44bd-a67b-b545817aeb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:45.603550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:45.687409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1196/2416] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:45.703710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:45.705314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:45.773626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488583a9-eb6d-4c4a-a992-d968a908a7ba service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:45.779583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:45.780218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:45.780564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:45.780847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:45.783013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:45.874584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:45.876188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:45.897276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1221/2417] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:40:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:40:46.339597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ccbcc-c40b-43eb-aa9f-f74e698748b1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:46.339891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ccbcc-c40b-43eb-aa9f-f74e698748b1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:46.340523 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ccbcc-c40b-43eb-aa9f-f74e698748b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:46.361572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1d7ccbcc-c40b-43eb-aa9f-f74e698748b1 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:46.362870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d7ccbcc-c40b-43eb-aa9f-f74e698748b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:46.371708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1197/2418] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:40:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:40:46.386168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:40:46.406504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f77a68-5eff-414b-a11f-8d4339613a05 service glance] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:40:46.417793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:40:46.417793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:46.417793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:46.417793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:46.431101 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:40:46.433809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:40:46.445916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1222/2419] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:40:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:40:56.356775 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=23 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:56.439942 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:58.624220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5616967-80b9-4a6b-ab3e-154505f378a5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:40:58.624774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5616967-80b9-4a6b-ab3e-154505f378a5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:40:58.624774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5616967-80b9-4a6b-ab3e-154505f378a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:40:58.644383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f5616967-80b9-4a6b-ab3e-154505f378a5 None None] MFA Rules not processed for user `fc7e4139db574e40b9b7c6188489d2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:40:58.645587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f5616967-80b9-4a6b-ab3e-154505f378a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:40:58.653268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1198/2420] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:40:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:01.643333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:01.645360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:01.737782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7710-f42a-457b-89bc-85fbf59e6f31 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:01.743972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:01.744568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:01.744849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:01.745186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:01.747402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:01.759996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:01.761578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:01.773422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1223/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:41:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:41:05.531591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9f2e-e2f0-4f5f-a1ac-d709c599f6b2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:05.532123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9f2e-e2f0-4f5f-a1ac-d709c599f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:05.532123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9f2e-e2f0-4f5f-a1ac-d709c599f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:05.557326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-910d9f2e-e2f0-4f5f-a1ac-d709c599f6b2 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:05.558587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-910d9f2e-e2f0-4f5f-a1ac-d709c599f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:05.571404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1199/2422] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:41:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:05.578529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:05.590229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74041-0499-4523-ae79-1a293c389dad service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:05.595541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feed01e-6b8c-4931-ad59-404cccd4b454 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:05.596256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feed01e-6b8c-4931-ad59-404cccd4b454 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:05.596604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feed01e-6b8c-4931-ad59-404cccd4b454 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:05.596945 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feed01e-6b8c-4931-ad59-404cccd4b454 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:05.605940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feed01e-6b8c-4931-ad59-404cccd4b454 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:05.607776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feed01e-6b8c-4931-ad59-404cccd4b454 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:05.617988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1224/2423] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:41:15.550887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:15.613757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=38 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:17.066167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae2a51-a463-443d-b018-e6ab776f2aa0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:17.069101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae2a51-a463-443d-b018-e6ab776f2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:17.069101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae2a51-a463-443d-b018-e6ab776f2aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:17.088384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-81ae2a51-a463-443d-b018-e6ab776f2aa0 None None] MFA Rules not processed for user `50806523a01f4306a729e49b6f8af4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:17.089583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-81ae2a51-a463-443d-b018-e6ab776f2aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:17.096514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1200/2424] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:41:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:19.199920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:19.200435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:19.200531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:19.219795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] MFA Rules not processed for user `3309a24e48f243b2a7d9b84adb1dd815`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:19.220990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:19.275521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1225/2425] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:41:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:27.083164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:29.268769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=25 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:33.869938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b137b5-8402-4fcc-b4bb-ae1358fb65ab None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:33.870566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b137b5-8402-4fcc-b4bb-ae1358fb65ab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:33.870566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b137b5-8402-4fcc-b4bb-ae1358fb65ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:33.892503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-22b137b5-8402-4fcc-b4bb-ae1358fb65ab None None] MFA Rules not processed for user `f4266683d5cd4716b33df6377ffa498b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:33.893734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-22b137b5-8402-4fcc-b4bb-ae1358fb65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:33.964128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1201/2426] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:41:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:35.326088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:35.327520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:35.341614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8891f5-cc40-4bf1-aa6d-b76989fdb6c8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:35.346941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:35.347747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:35.348069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:35.350938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:35.363984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:35.366153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:35.381059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1226/2427] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:41:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:41:43.953978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=25 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:45.372793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:47.434419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8587b70-a9ea-4e91-9e62-7e51b149164e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:47.436911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8587b70-a9ea-4e91-9e62-7e51b149164e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:47.436911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8587b70-a9ea-4e91-9e62-7e51b149164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:47.454282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a8587b70-a9ea-4e91-9e62-7e51b149164e None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:47.455404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a8587b70-a9ea-4e91-9e62-7e51b149164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:47.462880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1202/2428] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:47.485264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:47.497251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238781c1-6bde-469c-ad31-7e451ceed9f5 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:47.502245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16b0ee-1afa-40a6-a854-ae90f3b9b05c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:47.502838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b0ee-1afa-40a6-a854-ae90f3b9b05c service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:47.503114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b0ee-1afa-40a6-a854-ae90f3b9b05c service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:47.503511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16b0ee-1afa-40a6-a854-ae90f3b9b05c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:47.513268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16b0ee-1afa-40a6-a854-ae90f3b9b05c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:47.514974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16b0ee-1afa-40a6-a854-ae90f3b9b05c service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:47.523435 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1227/2429] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:41:54.653631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:54.653631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:54.653631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:54.674522 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] MFA Rules not processed for user `1b5b8c2d0ea44352b58b4887b5836bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:54.675954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:54.807682 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1203/2430] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:41:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:57.520222 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:04.799476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=28 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:05.229788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:05.230376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:05.230482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:05.252762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:05.254025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:05.264071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1228/2431] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 24 09:42:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:05.274678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:05.286910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3c48-ffa4-4ae5-904d-41a02dbcd941 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:05.292157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:05.292779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:05.293056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:05.293327 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:05.302340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:05.303922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:05.313026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1204/2432] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:42:08.669395 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:08.681012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf2b6-a7b2-44cf-a25b-b29f0dd5eb19 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:08.686362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:08.687107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:08.687303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:08.687525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] PATH_INFO: `/v3/users/50806523a01f4306a729e49b6f8af4b5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:08.688642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50806523a01f4306a729e49b6f8af4b5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:08.690773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:08.820227 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50806523a01f4306a729e49b6f8af4b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:08.885866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50806523a01f4306a729e49b6f8af4b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:08.886587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50806523a01f4306a729e49b6f8af4b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:08.901321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50806523a01f4306a729e49b6f8af4b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:08.902058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7340279c-6487-422d-b990-4edea1abf155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50806523a01f4306a729e49b6f8af4b5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:08.914870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1229/2433] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:42:08 2022] DELETE /identity/v3/users/50806523a01f4306a729e49b6f8af4b5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:09.149460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.161187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ffd32-e610-4f55-9090-bdc1d5baac5b service swift] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.235364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.235945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.236528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.236786 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] PATH_INFO: `/v3/projects/be535a0b328b42f1a22831fe134e7f74` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.237981 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be535a0b328b42f1a22831fe134e7f74)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:09.239983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:09.358863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be535a0b328b42f1a22831fe134e7f74', 'request_id': 'req-f1b5bf83-47d0-4236-acd8-259469a75195'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:09.364785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be535a0b328b42f1a22831fe134e7f74', 'request_id': 'req-f1b5bf83-47d0-4236-acd8-259469a75195'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:09.416404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be535a0b328b42f1a22831fe134e7f74', 'request_id': 'req-f1b5bf83-47d0-4236-acd8-259469a75195'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:09.428690 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] The token cache is being invalidate because project be535a0b328b42f1a22831fe134e7f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:42:09.428980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:09.429635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1b5bf83-47d0-4236-acd8-259469a75195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:09.431149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1205/2434] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:42:09 2022] DELETE /identity/v3/projects/be535a0b328b42f1a22831fe134e7f74 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:09.436327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.436686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.437027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.456107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:09.457342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:09.516827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1230/2435] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:42:09.524493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.524793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.525067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.545896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:09.547098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:09.555334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1206/2436] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:09.559782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.569552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8347f8-5758-4ce9-a6eb-2f37a5e8edbd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.574309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.574930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.575212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.575485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.576144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:42:09.576448 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:09.578093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:09.591134 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1231/2437] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:42:09.595135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.604807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd784063-ccc2-469c-9c54-1cd23c49d562 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.613739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.614418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.614693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.614965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.615604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:09.617533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:09.724128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1207/2438] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:42:09 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:42:09.728419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.740515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c0b1d-f398-428f-8eca-70b17b34b13a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.791426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:09.800457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.802981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.802981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.802981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.802981 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:09.804316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:09.892260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1232/2439] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:42:09 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:42:09.896689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.907887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf2fd-9b8c-4e4a-9d71-58222899daac admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.912603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.913230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.913520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.913797 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.914479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:09.916098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:09.926485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1208/2440] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:42:09.930602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.940557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ab88c-1ee3-439c-acce-18a30622b6d5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.945445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ce8dd-2edc-4557-89e2-ffe0e1590c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.946166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ce8dd-2edc-4557-89e2-ffe0e1590c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.946514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ce8dd-2edc-4557-89e2-ffe0e1590c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.946804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ce8dd-2edc-4557-89e2-ffe0e1590c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:09.947673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ce8dd-2edc-4557-89e2-ffe0e1590c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:09.950340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ce8dd-2edc-4557-89e2-ffe0e1590c0a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:09.962318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1233/2441] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:42:09.975208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:09.985380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429560-b3f8-4c2b-a56e-5db95059723d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:09.990405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:09.991057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:09.991343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:09.991624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] PATH_INFO: `/v3/projects/4dbfd6c219cc49b3b504dbb1f5f5c66e/users/af988463df3844e1b493477d1533074a/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:10.006866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbfd6c219cc49b3b504dbb1f5f5c66e, user_id=af988463df3844e1b493477d1533074a, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:10.009554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:10.069987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1209/2442] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:42:09 2022] PUT /identity/v3/projects/4dbfd6c219cc49b3b504dbb1f5f5c66e/users/af988463df3844e1b493477d1533074a/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:10.082157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:10.082464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:10.082716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:10.113167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] MFA Rules not processed for user `af988463df3844e1b493477d1533074a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:10.114434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:10.182837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1234/2443] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:10.195630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:10.197430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:10.212207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:10.256996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcb555-ecb4-44b2-9743-db6f52e0a9e9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:10.260800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36206200-ed51-42bb-a703-3e627d45adc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:10.261416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206200-ed51-42bb-a703-3e627d45adc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:10.262276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206200-ed51-42bb-a703-3e627d45adc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:10.262581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206200-ed51-42bb-a703-3e627d45adc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:10.271925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36206200-ed51-42bb-a703-3e627d45adc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:10.273425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36206200-ed51-42bb-a703-3e627d45adc6 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:10.284967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1210/2444] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:13.399733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:13.473529 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8da5bb-e089-4ed0-9dc4-1a6f60ab2073 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:13.478383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:13.479166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:13.479507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:13.479877 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] PATH_INFO: `/v3/users/af988463df3844e1b493477d1533074a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:13.482010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af988463df3844e1b493477d1533074a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:13.483999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:13.665210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af988463df3844e1b493477d1533074a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:13.720566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af988463df3844e1b493477d1533074a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:13.721887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af988463df3844e1b493477d1533074a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:13.731602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:13.738237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af988463df3844e1b493477d1533074a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:13.739068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af988463df3844e1b493477d1533074a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:13.753063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1235/2445] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:42:13 2022] DELETE /identity/v3/users/af988463df3844e1b493477d1533074a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:13.757609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:13.759253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:13.759253 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:13.778521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:13.779753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:13.863983 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1211/2446] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:13.914700 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:13.916226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:13.981544 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7f41c-d86c-45df-9ccc-7b9a860d3330 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:13.985352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:13.986001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:13.986571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:13.987054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:13.998191 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:13.999748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:14.012181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1236/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:14.787368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:14.789059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:14.812944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e12bf-2e62-470c-afd0-b065b6a217e0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:14.832703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:14.833631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:14.834854 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:14.835344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] PATH_INFO: `/v3/projects/4dbfd6c219cc49b3b504dbb1f5f5c66e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:14.836823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbfd6c219cc49b3b504dbb1f5f5c66e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:14.839720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:14.964390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbfd6c219cc49b3b504dbb1f5f5c66e', 'request_id': 'req-de29eddf-93e0-46d8-badb-cff07c88f479'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:14.971807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbfd6c219cc49b3b504dbb1f5f5c66e', 'request_id': 'req-de29eddf-93e0-46d8-badb-cff07c88f479'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:15.039934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbfd6c219cc49b3b504dbb1f5f5c66e', 'request_id': 'req-de29eddf-93e0-46d8-badb-cff07c88f479'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:15.055706 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] The token cache is being invalidate because project 4dbfd6c219cc49b3b504dbb1f5f5c66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:42:15.056411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:15.057319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:15.061044 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1212/2448] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:42:14 2022] DELETE /identity/v3/projects/4dbfd6c219cc49b3b504dbb1f5f5c66e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:24.013151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=34,keystone:DELETE=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:25.052378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:34.940891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:34.942664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:34.958215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1ecad-daff-45a4-87ca-5277b144a904 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:35.018151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:35.018802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:35.019089 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:35.019360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] PATH_INFO: `/v3/users/3309a24e48f243b2a7d9b84adb1dd815` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:35.020620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3309a24e48f243b2a7d9b84adb1dd815)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:35.022600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:35.191419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3309a24e48f243b2a7d9b84adb1dd815'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.251054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3309a24e48f243b2a7d9b84adb1dd815'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.252003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3309a24e48f243b2a7d9b84adb1dd815'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.265908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3309a24e48f243b2a7d9b84adb1dd815'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.267477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f485ab7d-5459-424c-88ba-67d102e8c0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3309a24e48f243b2a7d9b84adb1dd815'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.280436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1237/2449] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:42:34 2022] DELETE /identity/v3/users/3309a24e48f243b2a7d9b84adb1dd815 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:35.515151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:35.518258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:35.537686 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29eddf-93e0-46d8-badb-cff07c88f479 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:35.600037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:35.600683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:35.600972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:35.601249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] PATH_INFO: `/v3/projects/5819536ee009471cb564a69f4a6bdb39` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:35.602459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5819536ee009471cb564a69f4a6bdb39)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:35.604456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:35.698887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5819536ee009471cb564a69f4a6bdb39', 'request_id': 'req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.705883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5819536ee009471cb564a69f4a6bdb39', 'request_id': 'req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.787997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5819536ee009471cb564a69f4a6bdb39', 'request_id': 'req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.800598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] The token cache is being invalidate because project 5819536ee009471cb564a69f4a6bdb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:42:35.801060 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.801738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4cd8e82b-4413-4b7c-b673-6a7c39aad8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:42:35.803490 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1213/2450] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:42:35 2022] DELETE /identity/v3/projects/5819536ee009471cb564a69f4a6bdb39 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:35.808402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:35.808771 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:35.809116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:35.832761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:35.834116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:35.904957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1238/2451] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:42:35.914319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5508-b69c-491e-aa45-590d32657678 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:35.917009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5508-b69c-491e-aa45-590d32657678 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:35.917009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5508-b69c-491e-aa45-590d32657678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:35.934976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-73de5508-b69c-491e-aa45-590d32657678 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:35.936214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73de5508-b69c-491e-aa45-590d32657678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:35.945002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1214/2452] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:35.949213 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:35.959751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e2e1d-7fae-4dd8-b65c-8a877f863e82 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:35.964311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:35.964916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:35.965198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:35.965643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:35.966193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:42:35.966495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:35.968102 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:35.980557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1239/2453] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:42:35.985214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de5508-b69c-491e-aa45-590d32657678 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:35.995455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de5508-b69c-491e-aa45-590d32657678 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:36.000346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:36.003014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.003014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.003014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.003014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:36.004693 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:36.106751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1215/2454] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:42:35 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:42:36.111925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:36.126788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf44283-4aea-45c7-8fee-f7f97bb80a4b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:36.131675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:36.194130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:36.194725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.194994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.195271 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.196091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:36.198080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:36.257986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1240/2455] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:42:36 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:42:36.262266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:36.273360 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672b6c-6163-4696-9c7d-1021f3e1560e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:36.278236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:36.278848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.279128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.279397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.280039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:36.281641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:36.292117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1216/2456] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:42:36.296308 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:36.307446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae44e0-ff65-420a-bd00-9415ef3bd1c2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:36.312635 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba499250-0d03-4450-b163-338d73dd4c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:36.313974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499250-0d03-4450-b163-338d73dd4c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.314223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499250-0d03-4450-b163-338d73dd4c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.314506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499250-0d03-4450-b163-338d73dd4c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.315149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba499250-0d03-4450-b163-338d73dd4c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:36.316751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba499250-0d03-4450-b163-338d73dd4c2b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:36.328192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1241/2457] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:42:36.332570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:36.342793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0e1b-7bf2-4c9e-b40c-edee61d2d053 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:36.354202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:36.355667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.355957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.356264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] PATH_INFO: `/v3/projects/e058ec23c62e460ba470383b046d1c6c/users/b041a3806ef04fc080c15b838e81b6ca/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.373711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e058ec23c62e460ba470383b046d1c6c, user_id=b041a3806ef04fc080c15b838e81b6ca, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:36.376946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:36.479601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1217/2458] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:42:36 2022] PUT /identity/v3/projects/e058ec23c62e460ba470383b046d1c6c/users/b041a3806ef04fc080c15b838e81b6ca/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:42:36.484776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d1aa3-b2d9-40f6-99d2-06162b9652a3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.485940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d1aa3-b2d9-40f6-99d2-06162b9652a3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.486226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d1aa3-b2d9-40f6-99d2-06162b9652a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.506853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2c0d1aa3-b2d9-40f6-99d2-06162b9652a3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:36.509380 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2c0d1aa3-b2d9-40f6-99d2-06162b9652a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:36.571373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1242/2459] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:36.581245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:36.583017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:36.619540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:36.647370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dc96e-0da3-4057-8fcf-93dd9063c288 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:36.651439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:36.652055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:36.652334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:36.652613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:36.663682 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:36.665138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:36.679664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1218/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:42.396072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72687-e6bf-41e0-8ee7-54e334121a21 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:42.396551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72687-e6bf-41e0-8ee7-54e334121a21 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:42.396551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72687-e6bf-41e0-8ee7-54e334121a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:42.424376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-afc72687-e6bf-41e0-8ee7-54e334121a21 None None] MFA Rules not processed for user `b041a3806ef04fc080c15b838e81b6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:42.425602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-afc72687-e6bf-41e0-8ee7-54e334121a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:42.490534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1243/2461] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:42.507795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:42.509462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:42.585287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0aab0-5d5e-4121-93b1-d4d0aa75aaf0 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:42.591010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:42.591617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:42.591899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:42.592173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:42.600639 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:42.602293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:42.612407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1219/2462] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:44.825473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:44.825473 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:44.826014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:44.847690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] MFA Rules not processed for user `b041a3806ef04fc080c15b838e81b6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:44.848805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:44.855875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1244/2463] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:42:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:48.067772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:48.077838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93988749-d985-470f-a99d-b44cffab2b88 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:48.082622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:48.083228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:48.083512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:48.083829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:48.085732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:48.100285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:48.101721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344669b6-ec63-4ae0-aaf3-0e94d1c0d3ad service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:48.114388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1220/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:49.119160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:49.129537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba519e92-a024-4e64-999e-da5d9c1c8f6a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:49.133689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:49.134432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:49.134843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:49.135117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:49.136873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:49.149387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:49.151344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:49.153817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:49.166939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1245/2465] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:42:54.856072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:54.861566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:54.861566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:54.879465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:54.881297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:54.950251 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1221/2466] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:42:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:54.973714 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:54.975554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:55.047727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec3c46-56b4-456b-bd0b-631b8d5f1794 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:55.053030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:55.053706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:55.054021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:55.054295 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:55.062817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:55.064488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:55.073479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1246/2467] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:43:04.943281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=79 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:05.069620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=34 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:06.691926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:06.693941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:06.758408 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e5a1f-59b7-46b9-b430-00cf35fd9e67 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:06.769249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:06.769249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:06.770459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:06.770459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:06.770459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:06.770459 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:06.770845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:06.780898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f13dd-9dbd-42b1-99b4-05711db8faf9 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:06.787553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:06.788244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:06.788634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:06.795790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:06.798397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:06.862017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:06.862017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:06.873383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1222/2468] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:06.878725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:06.883672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:06.895522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1247/2469] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:07.479390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:07.493430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da182-17d2-4ad7-bf36-1562e776fa11 service glance] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:07.498849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:07.499500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:07.499781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:07.500125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:07.501848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:07.563035 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:07.564652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafdb64-aa5f-4d95-979e-3c2f43b327c9 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:07.573779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1223/2470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:15.648853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:15.656804 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2af1f6-57aa-4b1f-ab73-968baacfa72a service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:15.660647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:15.661255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:15.662151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:15.662542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:15.664636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:15.675356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:15.676999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f47b27-109b-4b14-825d-e2e1b3e8b1ac service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:15.686795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1248/2471] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:16.201337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fcfc-375f-4ac8-a039-f5a720d0bea6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.201971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fcfc-375f-4ac8-a039-f5a720d0bea6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.202061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fcfc-375f-4ac8-a039-f5a720d0bea6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.203729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1224/2472] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:16.210431 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515d5a-5289-4958-bd6d-3fbd40da1221 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.210727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515d5a-5289-4958-bd6d-3fbd40da1221 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.211011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a515d5a-5289-4958-bd6d-3fbd40da1221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.231444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1a515d5a-5289-4958-bd6d-3fbd40da1221 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:16.232683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1a515d5a-5289-4958-bd6d-3fbd40da1221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.243458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1249/2473] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:43:16.256274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fcfc-375f-4ac8-a039-f5a720d0bea6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:16.270647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fcfc-375f-4ac8-a039-f5a720d0bea6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:16.274942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7649a8-7790-410d-a5e3-f211d1d5bf53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:16.275576 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7649a8-7790-410d-a5e3-f211d1d5bf53 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.275857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7649a8-7790-410d-a5e3-f211d1d5bf53 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.276137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7649a8-7790-410d-a5e3-f211d1d5bf53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.286622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7649a8-7790-410d-a5e3-f211d1d5bf53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:16.288034 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7649a8-7790-410d-a5e3-f211d1d5bf53 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:16.298552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1225/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:43:16.531023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be27b-f21b-421a-a031-e75bd2532590 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.531307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be27b-f21b-421a-a031-e75bd2532590 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.531580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be27b-f21b-421a-a031-e75bd2532590 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.532943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1250/2475] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:43:16.538810 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5257b-72ac-48d5-9c14-9f4a94d8b070 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.539097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5257b-72ac-48d5-9c14-9f4a94d8b070 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.539397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5257b-72ac-48d5-9c14-9f4a94d8b070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.560061 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d9c5257b-72ac-48d5-9c14-9f4a94d8b070 None None] MFA Rules not processed for user `072c1d4765474a91b9ceca1727432fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:16.561285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d9c5257b-72ac-48d5-9c14-9f4a94d8b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.569075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1226/2476] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:16.582527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1be27b-f21b-421a-a031-e75bd2532590 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:16.584002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9e1be27b-f21b-421a-a031-e75bd2532590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.597956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1be27b-f21b-421a-a031-e75bd2532590 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:16.602251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550fb05-445d-499a-be77-cbb82835cd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:16.602790 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550fb05-445d-499a-be77-cbb82835cd58 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.603070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550fb05-445d-499a-be77-cbb82835cd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.603345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550fb05-445d-499a-be77-cbb82835cd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.611094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550fb05-445d-499a-be77-cbb82835cd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:16.613196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550fb05-445d-499a-be77-cbb82835cd58 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:16.620867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1251/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:16.704571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44173a9-a4bf-47a3-8eb7-ad4de8a5d092 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.704911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44173a9-a4bf-47a3-8eb7-ad4de8a5d092 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.705190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44173a9-a4bf-47a3-8eb7-ad4de8a5d092 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.706715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1227/2478] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 24 09:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:16.713352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.713834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.713948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.734784 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] MFA Rules not processed for user `63691cb1f90744c497aaddd6139d5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:16.736007 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.746537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1252/2479] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 24 09:43:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:16.757829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44173a9-a4bf-47a3-8eb7-ad4de8a5d092 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:16.769385 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44173a9-a4bf-47a3-8eb7-ad4de8a5d092 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:16.773297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:16.774029 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.774299 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.774571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.785036 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:16.786504 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:16.797547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1228/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:16.863104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:16.864471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.934664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068400a8-35d6-4f2a-bd20-d35eb1233ee6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:16.939923 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151007af-6665-4e84-8286-c93913524334 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:16.940530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151007af-6665-4e84-8286-c93913524334 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.940809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151007af-6665-4e84-8286-c93913524334 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.941080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151007af-6665-4e84-8286-c93913524334 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.943505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-151007af-6665-4e84-8286-c93913524334 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.955046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151007af-6665-4e84-8286-c93913524334 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:16.961348 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151007af-6665-4e84-8286-c93913524334 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:16.966443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1253/2481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:18.996528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:19.005238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce906d0a-5f51-4645-9cef-70857ba6420f service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:19.009374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:19.009994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:19.013491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:19.013491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:19.013491 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:19.024915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:19.026359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5abe40-01ab-4148-846c-fda6ecdef268 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:19.035902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1229/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:20.298791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151007af-6665-4e84-8286-c93913524334 service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:20.324996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151007af-6665-4e84-8286-c93913524334 service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:20.329207 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:20.329823 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:20.330425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:20.330750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:20.332636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:20.347041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:20.349633 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:20.359315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1254/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:21.744365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cd772-6699-4fb3-a609-269e9996d2f0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:21.744894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cd772-6699-4fb3-a609-269e9996d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:21.744894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cd772-6699-4fb3-a609-269e9996d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:21.759246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:21.764525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-116cd772-6699-4fb3-a609-269e9996d2f0 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:21.765727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-116cd772-6699-4fb3-a609-269e9996d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:21.773802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1230/2484] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 24 09:43:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:21.786149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:21.801019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08388590-0e53-48cd-bafa-b7667579fbd2 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:21.816080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:21.816990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:21.817428 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:21.817729 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:21.830661 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:21.832347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:21.854352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1255/2485] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:43:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:43:22.555131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:22.555663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:22.556122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:22.595882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:22.599806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:22.630420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1231/2486] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 24 09:43:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:22.644511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:22.657095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebad5a-8e1f-4b43-b0c3-17c8ef327c2a service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:22.683821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:22.684868 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:22.685452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:22.686209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:22.699104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:22.701273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:22.715835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1256/2487] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:43:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:43:23.320534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:23.322142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:23.345614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dfc27-4d6a-4902-9b8b-3dacf61cb443 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:23.359794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:23.360449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:23.360727 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:23.361164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] PATH_INFO: `/v3/users/1b5b8c2d0ea44352b58b4887b5836bc6` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:23.362376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5b8c2d0ea44352b58b4887b5836bc6)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:23.364456 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:23.534086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5b8c2d0ea44352b58b4887b5836bc6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:23.535577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5b8c2d0ea44352b58b4887b5836bc6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:23.535577 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5b8c2d0ea44352b58b4887b5836bc6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:23.543249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5b8c2d0ea44352b58b4887b5836bc6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:23.562966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9f8bc722-17c3-4db0-ab15-10d5c1eb8503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5b8c2d0ea44352b58b4887b5836bc6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:23.669465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1232/2488] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:23 2022] DELETE /identity/v3/users/1b5b8c2d0ea44352b58b4887b5836bc6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:24.064154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:24.076628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e0cb6-63f2-49f5-9231-a35b9a3e1899 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:24.082321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:24.142096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:24.142737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:24.143021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:24.143292 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] PATH_INFO: `/v3/projects/e8a440e0b7d2444caf43b038402db65f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:24.144476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a440e0b7d2444caf43b038402db65f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:24.146426 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:24.311999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a440e0b7d2444caf43b038402db65f', 'request_id': 'req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:24.326918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a440e0b7d2444caf43b038402db65f', 'request_id': 'req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:24.749022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a440e0b7d2444caf43b038402db65f', 'request_id': 'req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:24.762296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] The token cache is being invalidate because project e8a440e0b7d2444caf43b038402db65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:24.762610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:24.763254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-5fa23dc9-716e-40d2-8e0e-9fae55b8a259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:24.765010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1257/2489] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:24 2022] DELETE /identity/v3/projects/e8a440e0b7d2444caf43b038402db65f => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:24.771113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:24.771796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:24.772483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:24.793632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:24.795967 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:24.886374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1233/2490] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:24.888692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:24.889171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:24.889692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:24.926046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:24.928133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:24.953612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1258/2491] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:24.954756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:24.967062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995db659-642b-4ac1-9c03-96ddf4da23a9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:24.974108 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:24.974362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:24.974547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:24.974822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:24.976161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:43:24.976461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:24.978361 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:24.998501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1234/2492] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:43:25.000106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:25.011080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea590e-e5ff-4278-b5db-15f5c8edd0f6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:25.016563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:25.017196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.020277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.020277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.020277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:25.020735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:25.135372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:25.140972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1259/2493] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:24 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:25.149811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba6b1f-1a98-450e-9663-89ced5b73d6e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:25.232384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:25.256063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:25.257368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.257657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.258102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.258758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:25.260817 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:25.362619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1235/2494] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:25 2022] POST /identity/v3/users => generated 282 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:25.367405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:25.379808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dba2c-ab90-4069-af50-90b626f0433e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:25.398339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:25.398989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.399274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.399550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.400455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:25.402634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:25.428117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1260/2495] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:25.432450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:25.444899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798cbac-d5a4-4a26-af3a-62fb2797fdd7 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:25.462506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437b019-4bd0-486f-a437-92b1d88aadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:25.463581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437b019-4bd0-486f-a437-92b1d88aadbe admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.463846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437b019-4bd0-486f-a437-92b1d88aadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.464627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437b019-4bd0-486f-a437-92b1d88aadbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.465305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437b019-4bd0-486f-a437-92b1d88aadbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:25.467492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437b019-4bd0-486f-a437-92b1d88aadbe admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:25.481371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1236/2496] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:25.485521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:25.497343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb541e6-a3ab-4d6f-814b-6d49938bfff8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:25.512141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:25.513235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.513780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.514373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] PATH_INFO: `/v3/projects/4a8337e99a45476e847e9dc699081638/users/e2044bb8b1e7455bbb648caa3faf3cc9/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.544450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8337e99a45476e847e9dc699081638, user_id=e2044bb8b1e7455bbb648caa3faf3cc9, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:25.547437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:25.663733 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1261/2497] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:25 2022] PUT /identity/v3/projects/4a8337e99a45476e847e9dc699081638/users/e2044bb8b1e7455bbb648caa3faf3cc9/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:25.667230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.667519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.667988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.721785 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] MFA Rules not processed for user `e2044bb8b1e7455bbb648caa3faf3cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:25.723806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:25.810701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1237/2498] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:25.814896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:25.876139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:25.920922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee6125-d4a4-4927-9c40-bd7c0d7b05e0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:25.926442 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:25.927317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:25.927897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:25.928806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:25.929589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:25.931624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:26.034329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1262/2499] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:25 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:26.035475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:26.060043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271fc1c-6ebd-49df-ac3e-1174a99ae9c8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:26.175537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:26.176081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.176366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.176664 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.177290 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:26.179388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:26.279594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1238/2500] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:26 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:43:26.283445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:26.298140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e3ad2-a126-4f57-9810-3f6ee36590f3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:26.307045 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:26.307922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.308631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.309077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.310235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:26.312039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:26.330541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1263/2501] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:26.332732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:26.347902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c076e-5f2d-47c3-beaf-3e3965c43cb2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:26.359920 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:26.361338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.361916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.362446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] PATH_INFO: `/v3/projects/da1e4655a24b4388a8185122141865c5/users/aee5f99e5d7141a5a3e6c699c99cc084/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.389359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1e4655a24b4388a8185122141865c5, user_id=aee5f99e5d7141a5a3e6c699c99cc084, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:26.392900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:26.457255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1239/2502] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:26 2022] PUT /identity/v3/projects/da1e4655a24b4388a8185122141865c5/users/aee5f99e5d7141a5a3e6c699c99cc084/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:26.460630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:26.471406 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d377-7b7b-4816-8c84-97cff3538f67 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:26.541919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d45b5f-165d-464b-b13a-5f20eed45cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:26.542642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d45b5f-165d-464b-b13a-5f20eed45cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.542928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d45b5f-165d-464b-b13a-5f20eed45cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.543197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d45b5f-165d-464b-b13a-5f20eed45cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.543921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d45b5f-165d-464b-b13a-5f20eed45cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:26.545600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d45b5f-165d-464b-b13a-5f20eed45cd7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:26.560034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1264/2503] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:26.561573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:26.573139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85557532-da51-45e3-9691-4880ac1c129f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:26.580190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:26.581114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.581396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.581675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] PATH_INFO: `/v3/projects/da1e4655a24b4388a8185122141865c5/users/aee5f99e5d7141a5a3e6c699c99cc084/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.583966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1e4655a24b4388a8185122141865c5, user_id=aee5f99e5d7141a5a3e6c699c99cc084, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:26.587748 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:26.599530 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1240/2504] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:26 2022] PUT /identity/v3/projects/da1e4655a24b4388a8185122141865c5/users/aee5f99e5d7141a5a3e6c699c99cc084/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:26.614545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.614826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.615099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.677999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] MFA Rules not processed for user `aee5f99e5d7141a5a3e6c699c99cc084`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:26.680105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:26.838779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1265/2505] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:26.851940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:26.853934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:26.878116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:26.956353 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143e95f-f61d-47f0-914d-9c793bee7787 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:26.962150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4188c-72f4-4e20-a8b4-d764b26013df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:26.963129 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4188c-72f4-4e20-a8b4-d764b26013df service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:26.963445 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4188c-72f4-4e20-a8b4-d764b26013df service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:26.966344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4188c-72f4-4e20-a8b4-d764b26013df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:26.975835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4188c-72f4-4e20-a8b4-d764b26013df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:26.977511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4188c-72f4-4e20-a8b4-d764b26013df service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:27.000172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1241/2506] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:28.273185 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:28.331127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:28.372240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7600a18-c8e3-4a80-9567-c20a1ab87fd5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:28.378906 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:28.379619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:28.379908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:28.380186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] PATH_INFO: `/v3/users/e2044bb8b1e7455bbb648caa3faf3cc9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:28.381841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2044bb8b1e7455bbb648caa3faf3cc9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:28.383907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:28.613260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2044bb8b1e7455bbb648caa3faf3cc9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:28.718330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2044bb8b1e7455bbb648caa3faf3cc9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:28.718969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2044bb8b1e7455bbb648caa3faf3cc9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:28.735173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2044bb8b1e7455bbb648caa3faf3cc9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:28.735954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2044bb8b1e7455bbb648caa3faf3cc9'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:28.767408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1266/2507] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:28 2022] DELETE /identity/v3/users/e2044bb8b1e7455bbb648caa3faf3cc9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:28.772341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:28.772828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:28.773045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:28.812132 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:28.813375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:28.933351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1242/2508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:28.947595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:28.949384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:29.036578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e409-0e13-4a6f-91b5-8ce11c5e318b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:29.042537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:29.048830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:29.048830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:29.048830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:29.055835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:29.057248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:29.070643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1267/2509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:29.886767 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:29.898045 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:29.929395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2ac75-7a80-431f-ab9a-54d1d69e478f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:29.941138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:29.943413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:29.945218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:29.946378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] PATH_INFO: `/v3/projects/4a8337e99a45476e847e9dc699081638` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:29.950811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8337e99a45476e847e9dc699081638)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:29.955441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:30.070788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8337e99a45476e847e9dc699081638', 'request_id': 'req-3baded82-1d5e-48fd-838a-95aacbf17869'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.086020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8337e99a45476e847e9dc699081638', 'request_id': 'req-3baded82-1d5e-48fd-838a-95aacbf17869'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.147587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8337e99a45476e847e9dc699081638', 'request_id': 'req-3baded82-1d5e-48fd-838a-95aacbf17869'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.172945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] The token cache is being invalidate because project 4a8337e99a45476e847e9dc699081638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:30.173772 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.174020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.179933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1243/2510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:29 2022] DELETE /identity/v3/projects/4a8337e99a45476e847e9dc699081638 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:30.181550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:30.196578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114473-d770-4be8-b21c-6876f2cfb600 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:30.265666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:30.279777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:30.279777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:30.279777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:30.279777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] PATH_INFO: `/v3/users/aee5f99e5d7141a5a3e6c699c99cc084` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:30.280460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee5f99e5d7141a5a3e6c699c99cc084)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:30.282482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:30.506047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee5f99e5d7141a5a3e6c699c99cc084'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.574425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee5f99e5d7141a5a3e6c699c99cc084'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.575064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee5f99e5d7141a5a3e6c699c99cc084'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.590200 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee5f99e5d7141a5a3e6c699c99cc084'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.590984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7d64a4a9-e82f-4dcf-9750-310611bbbc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee5f99e5d7141a5a3e6c699c99cc084'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:30.606561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1268/2511] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:30 2022] DELETE /identity/v3/users/aee5f99e5d7141a5a3e6c699c99cc084 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:31.040140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:31.052641 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:31.061375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baded82-1d5e-48fd-838a-95aacbf17869 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:31.112116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:31.135177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:31.136266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:31.136565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:31.136837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] PATH_INFO: `/v3/projects/da1e4655a24b4388a8185122141865c5` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:31.138113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1e4655a24b4388a8185122141865c5)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:31.144677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:31.277097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1e4655a24b4388a8185122141865c5', 'request_id': 'req-14711026-2e76-4cd0-8548-fb5e6670233b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:31.285090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1e4655a24b4388a8185122141865c5', 'request_id': 'req-14711026-2e76-4cd0-8548-fb5e6670233b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:31.369070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1e4655a24b4388a8185122141865c5', 'request_id': 'req-14711026-2e76-4cd0-8548-fb5e6670233b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:31.380725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] The token cache is being invalidate because project da1e4655a24b4388a8185122141865c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:31.381531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:31.382319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-14711026-2e76-4cd0-8548-fb5e6670233b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:31.383692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1244/2512] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:31 2022] DELETE /identity/v3/projects/da1e4655a24b4388a8185122141865c5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:31.389008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:31.389490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:31.389583 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:31.414259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:31.416340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:31.528875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1269/2513] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:31.537148 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:31.537977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:31.538302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:31.572420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:31.575182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:31.592823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1245/2514] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:43:31.597839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:31.617357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638dd76-2c3c-4efc-9a85-f11b92810b5d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:31.627238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:31.631754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:31.631754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:31.631754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:31.633119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:43:31.633740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:31.638104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:31.673136 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1270/2515] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:43:31.679378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:31.700771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f9c69-2021-4126-9e74-b8c9a06106e1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:31.716677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:31.717566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:31.718019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:31.718451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:31.719202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:31.723416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:31.813918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1246/2516] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:31 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:31.816331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:31.834936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e747b0-9d71-4d38-b1c6-108d77afba8b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:31.906719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:31.907470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:31.907850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:31.908232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:31.908970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:31.911261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:31.920577 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:32.018432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1271/2517] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:31 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:32.019774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.031528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1d79c-1848-46f5-bbc6-033303f0e938 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.036824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.037505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.038024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.038556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.039142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.040769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.051818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1247/2518] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:32.056189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.070556 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1057f54-ae47-4b6d-90a5-9342836b9b1e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.078530 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bfbb6-8fb4-4a66-95c0-d6e1ebff384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.079322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bfbb6-8fb4-4a66-95c0-d6e1ebff384f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.079561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bfbb6-8fb4-4a66-95c0-d6e1ebff384f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.079833 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bfbb6-8fb4-4a66-95c0-d6e1ebff384f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.080494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bfbb6-8fb4-4a66-95c0-d6e1ebff384f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.083260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bfbb6-8fb4-4a66-95c0-d6e1ebff384f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.096903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1272/2519] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:32.101269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.114675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921aa98-d2d1-41ed-b858-8af08e39beca admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.121168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.122079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.122436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.122798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] PATH_INFO: `/v3/projects/6b077384a3ae40ae8007d60422141053/users/02a533fe91c84cf3b64e86e98c8ae241/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.141400 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b077384a3ae40ae8007d60422141053, user_id=02a533fe91c84cf3b64e86e98c8ae241, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.144735 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.227792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1248/2520] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:32 2022] PUT /identity/v3/projects/6b077384a3ae40ae8007d60422141053/users/02a533fe91c84cf3b64e86e98c8ae241/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:32.238564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.238853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.239123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.269979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] MFA Rules not processed for user `02a533fe91c84cf3b64e86e98c8ae241`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:32.271033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:32.353484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1273/2521] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:43:32.358381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.433287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5f12-23be-4b36-8481-35dbd0cad719 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.438815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.439656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.439990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.440340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.441089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.443138 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.468237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:32.572649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1249/2522] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:32 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:32.576676 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.590779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b140b7-14ea-4711-b61c-48dd88cd953a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.676013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.676344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.676628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.676935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.677566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.680363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.774003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1274/2523] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:32 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:32.775333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.788888 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23a5e-f07a-496a-a3ec-7a7976abe2a6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.795388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.796020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.796325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.796584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.798302 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.799234 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.816592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1250/2524] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:32.818668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.831349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25857b76-d57d-4e10-9f51-f097983ce93e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:32.836834 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:32.837515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:32.837796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:32.838103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] PATH_INFO: `/v3/projects/da9040c59983401cb228c50fd814745f/users/2477cfdda21241d9bd87fcb9a6e9774e/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:32.859801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9040c59983401cb228c50fd814745f, user_id=2477cfdda21241d9bd87fcb9a6e9774e, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:32.862603 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:32.941055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1275/2525] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:32 2022] PUT /identity/v3/projects/da9040c59983401cb228c50fd814745f/users/2477cfdda21241d9bd87fcb9a6e9774e/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:32.946537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:32.957535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e513c7-1924-4514-a878-4ab204ff9092 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:33.039919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e3390-b7d7-449c-af29-766681a4529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:33.040559 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3390-b7d7-449c-af29-766681a4529b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:33.040842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3390-b7d7-449c-af29-766681a4529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:33.041417 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e3390-b7d7-449c-af29-766681a4529b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:33.041811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e3390-b7d7-449c-af29-766681a4529b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:33.043887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e3390-b7d7-449c-af29-766681a4529b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:33.056334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1251/2526] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:33.061351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:33.076831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdc43b-b31f-4945-bf41-352aeb0b6d1d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:33.082122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:33.082806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:33.083087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:33.083363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] PATH_INFO: `/v3/projects/da9040c59983401cb228c50fd814745f/users/2477cfdda21241d9bd87fcb9a6e9774e/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:33.086180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9040c59983401cb228c50fd814745f, user_id=2477cfdda21241d9bd87fcb9a6e9774e, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:33.089025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:33.107623 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1276/2527] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:33 2022] PUT /identity/v3/projects/da9040c59983401cb228c50fd814745f/users/2477cfdda21241d9bd87fcb9a6e9774e/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:33.115137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:33.115137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:33.115137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:33.144135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] MFA Rules not processed for user `2477cfdda21241d9bd87fcb9a6e9774e`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:33.145367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:33.217233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1252/2528] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:33.229464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:33.231239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:33.254357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:33.292859 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ea3b-3063-454f-88ef-2f9d04db5838 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:33.296703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:33.297318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:33.297597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:33.297892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:33.307437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:33.308888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:33.318611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1277/2529] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:33.449741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:33.451425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:33.465422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ef5b-bb84-4dbd-b60f-018870605b87 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:33.470071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:33.475220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:33.475220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:33.475220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:33.538695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:33.543212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:33.545158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:33.549994 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1253/2530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:34.479541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:34.481589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:34.561912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b61a-1ee8-44ca-a793-bf8de400a0fa service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:34.566470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:34.567085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:34.567367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:34.567641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] PATH_INFO: `/v3/users/fc7e4139db574e40b9b7c6188489d2dd` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:34.568901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7e4139db574e40b9b7c6188489d2dd)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:34.570853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:34.789097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7e4139db574e40b9b7c6188489d2dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:34.860333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7e4139db574e40b9b7c6188489d2dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:34.860980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7e4139db574e40b9b7c6188489d2dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:34.874068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7e4139db574e40b9b7c6188489d2dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:34.874721 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7e4139db574e40b9b7c6188489d2dd'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:34.888461 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1278/2531] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:34 2022] DELETE /identity/v3/users/fc7e4139db574e40b9b7c6188489d2dd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:35.164830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:35.181436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b358f2a-c7d5-4c12-9dcc-acd183752956 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:35.247160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:35.247877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:35.248162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:35.248435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] PATH_INFO: `/v3/projects/c632259afb624d80a1e7efed4eb4348b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:35.250176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c632259afb624d80a1e7efed4eb4348b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:35.252072 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:35.396157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c632259afb624d80a1e7efed4eb4348b', 'request_id': 'req-41811d0f-ce04-4667-af12-7fdf5cbc3077'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.396157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c632259afb624d80a1e7efed4eb4348b', 'request_id': 'req-41811d0f-ce04-4667-af12-7fdf5cbc3077'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.483050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c632259afb624d80a1e7efed4eb4348b', 'request_id': 'req-41811d0f-ce04-4667-af12-7fdf5cbc3077'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.495222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] The token cache is being invalidate because project c632259afb624d80a1e7efed4eb4348b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:35.495511 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.496440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.497936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1254/2532] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:35 2022] DELETE /identity/v3/projects/c632259afb624d80a1e7efed4eb4348b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:35.502095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:35.503498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:35.517081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff7da-15c6-407e-8743-3a958c32c80d admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:35.565955 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:35.582467 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:35.583109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:35.583398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:35.583668 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] PATH_INFO: `/v3/users/1e83c6e37a8c4c7cb03de560139755fa` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:35.585498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e83c6e37a8c4c7cb03de560139755fa)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:35.587452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:35.830022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e83c6e37a8c4c7cb03de560139755fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.906707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e83c6e37a8c4c7cb03de560139755fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.907424 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e83c6e37a8c4c7cb03de560139755fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.925649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e83c6e37a8c4c7cb03de560139755fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.927156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a924c37-2259-429a-a3e8-18ddcbde4125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e83c6e37a8c4c7cb03de560139755fa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:35.947734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1279/2533] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:35 2022] DELETE /identity/v3/users/1e83c6e37a8c4c7cb03de560139755fa => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:36.310517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:36.312241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:36.352315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811d0f-ce04-4667-af12-7fdf5cbc3077 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:36.424323 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:36.425046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:36.428996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:36.428996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] PATH_INFO: `/v3/projects/83dbdd9eaed04e30bd12e9e108fdb024` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:36.428996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83dbdd9eaed04e30bd12e9e108fdb024)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:36.429528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:36.559497 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:36.571616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83dbdd9eaed04e30bd12e9e108fdb024', 'request_id': 'req-c8ef7327-3db7-4942-a966-82d257382cc0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:36.577069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83dbdd9eaed04e30bd12e9e108fdb024', 'request_id': 'req-c8ef7327-3db7-4942-a966-82d257382cc0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:36.728446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83dbdd9eaed04e30bd12e9e108fdb024', 'request_id': 'req-c8ef7327-3db7-4942-a966-82d257382cc0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:36.741878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] The token cache is being invalidate because project 83dbdd9eaed04e30bd12e9e108fdb024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:36.742179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:36.742885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:36.744422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1255/2534] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:36 2022] DELETE /identity/v3/projects/83dbdd9eaed04e30bd12e9e108fdb024 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:37.614019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:37.614858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:37.615624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:37.636123 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] MFA Rules not processed for user `6eaa26ac68db40ac9a4ebe47b7b5e814`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:37.637329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:37.702590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1280/2535] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 24 09:43:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:43:37.717516 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:37.718976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:37.795070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef7327-3db7-4942-a966-82d257382cc0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:37.800351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5571cc-be9d-48e5-966f-7ed99df8d58c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c16b4dc236344ffa2ef8cab86d6594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:37.800972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5571cc-be9d-48e5-966f-7ed99df8d58c service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:37.801278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5571cc-be9d-48e5-966f-7ed99df8d58c service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:37.801528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5571cc-be9d-48e5-966f-7ed99df8d58c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:37.810266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5571cc-be9d-48e5-966f-7ed99df8d58c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:37.811845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5571cc-be9d-48e5-966f-7ed99df8d58c service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:37.830928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1256/2536] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 24 09:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:43:39.293539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:39.294971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:39.369844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e70225-37cd-41cb-a90e-d0c5e77c4e83 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:39.374381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:39.375013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:39.375294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:39.375575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] PATH_INFO: `/v3/users/02a533fe91c84cf3b64e86e98c8ae241` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:39.376817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a533fe91c84cf3b64e86e98c8ae241)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:39.378764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:39.384542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:39.582088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a533fe91c84cf3b64e86e98c8ae241'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:39.665884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a533fe91c84cf3b64e86e98c8ae241'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:39.666515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a533fe91c84cf3b64e86e98c8ae241'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:39.680118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a533fe91c84cf3b64e86e98c8ae241'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:39.680787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a533fe91c84cf3b64e86e98c8ae241'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:39.693346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1281/2537] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:39 2022] DELETE /identity/v3/users/02a533fe91c84cf3b64e86e98c8ae241 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:39.697969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:39.698402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:39.698541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:39.718680 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:39.719880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:39.780063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1257/2538] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:39.790797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:39.792188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:39.854649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518cc0b-e364-4f0a-96c1-b2a30dbed21a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:39.859829 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:39.860447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:39.860731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:39.861019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:39.871922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:39.873367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:39.884508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1282/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:40.353544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:40.355085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:40.372336 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3497e6-a0c5-4615-80fa-47aecb03ba7b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:40.377335 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:40.379284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:40.379573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:40.379990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] PATH_INFO: `/v3/projects/6b077384a3ae40ae8007d60422141053` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:40.382561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b077384a3ae40ae8007d60422141053)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:40.384593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:40.504945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:40.508351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b077384a3ae40ae8007d60422141053', 'request_id': 'req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.515137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b077384a3ae40ae8007d60422141053', 'request_id': 'req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.603270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b077384a3ae40ae8007d60422141053', 'request_id': 'req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.616536 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] The token cache is being invalidate because project 6b077384a3ae40ae8007d60422141053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:40.616885 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.617546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.619293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1258/2540] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:40 2022] DELETE /identity/v3/projects/6b077384a3ae40ae8007d60422141053 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:40.624289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:40.639520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb1f88-0529-4750-8e54-9872f2c1d096 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:40.707355 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:40.707980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:40.708260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:40.708534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] PATH_INFO: `/v3/users/2477cfdda21241d9bd87fcb9a6e9774e` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:40.709838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2477cfdda21241d9bd87fcb9a6e9774e)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:40.712163 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:40.849574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:40.862648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2477cfdda21241d9bd87fcb9a6e9774e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.928658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2477cfdda21241d9bd87fcb9a6e9774e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.929313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2477cfdda21241d9bd87fcb9a6e9774e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.944253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2477cfdda21241d9bd87fcb9a6e9774e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.945230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-0e104486-1fc0-4a4c-a16f-a89ddef20ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2477cfdda21241d9bd87fcb9a6e9774e'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:40.958094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1283/2541] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:40 2022] DELETE /identity/v3/users/2477cfdda21241d9bd87fcb9a6e9774e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:41.382352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:41.383784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:41.399594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aefd9-8d5b-42c9-8f2a-6d82702c4a6e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:41.458769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:41.459404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:41.459683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:41.459953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] PATH_INFO: `/v3/projects/da9040c59983401cb228c50fd814745f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:41.461070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9040c59983401cb228c50fd814745f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:41.462988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:41.553057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9040c59983401cb228c50fd814745f', 'request_id': 'req-e876b801-8d6c-47cc-b265-fdb12b560141'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:41.558832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9040c59983401cb228c50fd814745f', 'request_id': 'req-e876b801-8d6c-47cc-b265-fdb12b560141'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:41.602756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9040c59983401cb228c50fd814745f', 'request_id': 'req-e876b801-8d6c-47cc-b265-fdb12b560141'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:41.616378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] The token cache is being invalidate because project da9040c59983401cb228c50fd814745f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:41.626552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:41.626552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e876b801-8d6c-47cc-b265-fdb12b560141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:41.626552 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1259/2542] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:41 2022] DELETE /identity/v3/projects/da9040c59983401cb228c50fd814745f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:41.627115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:41.627115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:41.627115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:41.645194 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:41.646501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:41.715844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1284/2543] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:41.723808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:41.724915 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:41.725483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:41.746758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:41.747963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:41.757713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1260/2544] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:41.762141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:41.771760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab850a-9d4e-4392-805e-3cb14e9ddca8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:41.776326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:41.776927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:41.778826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:41.778826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:41.778826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:43:41.778826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:41.779990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:41.792893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1285/2545] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:43:41.797381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:41.807394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f6e03-3b28-49be-8f6f-2c67a053aed4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:41.812112 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:41.812715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:41.815358 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:41.815646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:41.816275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:41.821583 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:41.896039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1261/2546] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:41 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:41.900262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:41.911516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64888d9-97b2-4513-a66f-59e18d19aa71 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:41.971313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:41.971933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:41.972245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:41.972516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:41.973159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:41.976162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.043971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1286/2547] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:41 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:43:42.048751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.059863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69063e95-cb37-4204-8afc-2f56108754aa admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.064760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.065488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.065769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.066186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.066833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.069097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.079804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1262/2548] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:42.084772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.097766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616eb612-9b73-4d81-87aa-c80f86dde87e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.104595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfabab3-145b-42b9-9f50-bf471a60d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.105245 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfabab3-145b-42b9-9f50-bf471a60d37a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.105531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfabab3-145b-42b9-9f50-bf471a60d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.105812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfabab3-145b-42b9-9f50-bf471a60d37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.106511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfabab3-145b-42b9-9f50-bf471a60d37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.108462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfabab3-145b-42b9-9f50-bf471a60d37a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.120645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1287/2549] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:42.124989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.135777 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c27c5-1773-4c06-b75c-ac88ece471c5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.142506 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.143150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.143832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.143832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] PATH_INFO: `/v3/projects/12cc282679e147239ad8706727472ff1/users/dc50f4071dfa4254a1a54e0206589524/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.161312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cc282679e147239ad8706727472ff1, user_id=dc50f4071dfa4254a1a54e0206589524, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.164974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.256542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:42.261514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1263/2550] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:42 2022] PUT /identity/v3/projects/12cc282679e147239ad8706727472ff1/users/dc50f4071dfa4254a1a54e0206589524/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:42.273562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.273849 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.274160 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.306042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:42.309111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] MFA Rules not processed for user `dc50f4071dfa4254a1a54e0206589524`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:42.310405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:42.384749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1288/2551] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:43:42.389376 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.459715 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fcdd0-b6dc-4c58-9101-734834ed83d6 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.465123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.465753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.466090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.466364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.467014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.468959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.565592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1264/2552] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:42 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:42.569951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.580864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0967-10c3-404b-914a-b2f509e04259 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.644239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.645115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.645115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.645434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.646214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.648177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.769880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1289/2553] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:42 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:42.775059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.785442 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4510f-d507-4db6-abea-7220be152054 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.791023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.791659 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.791941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.792214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.792855 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.794486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.806182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1265/2554] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:42.822171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.832458 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81bf5a-adeb-417e-b5e5-815767921dae admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:42.837598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:42.838307 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:42.838584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:42.838854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] PATH_INFO: `/v3/projects/2734a76719a5419db37653cae98f59de/users/4c0eae671ea443359249178345d7899f/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:42.854673 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2734a76719a5419db37653cae98f59de, user_id=4c0eae671ea443359249178345d7899f, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:42.857478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:42.931372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1290/2555] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:42 2022] PUT /identity/v3/projects/2734a76719a5419db37653cae98f59de/users/4c0eae671ea443359249178345d7899f/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:43:42.935566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:42.948452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50858b15-0ca5-4f1f-8c2b-6f35036cbb9f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:43.018757 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2305a0-885e-4e43-b94c-1b97c73cda46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:43.019365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2305a0-885e-4e43-b94c-1b97c73cda46 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:43.019655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2305a0-885e-4e43-b94c-1b97c73cda46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:43.019933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2305a0-885e-4e43-b94c-1b97c73cda46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:43.020587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2305a0-885e-4e43-b94c-1b97c73cda46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:43.022678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2305a0-885e-4e43-b94c-1b97c73cda46 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:43.036533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1266/2556] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:43.038208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:43.050216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134f54-01a7-4bba-9586-c78a72c6f015 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:43.056643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:43.057335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:43.057612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:43.057998 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] PATH_INFO: `/v3/projects/2734a76719a5419db37653cae98f59de/users/4c0eae671ea443359249178345d7899f/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:43.061605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2734a76719a5419db37653cae98f59de, user_id=4c0eae671ea443359249178345d7899f, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:43.064455 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:43.082484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1291/2557] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:43 2022] PUT /identity/v3/projects/2734a76719a5419db37653cae98f59de/users/4c0eae671ea443359249178345d7899f/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:43.094311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:43.102654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:43.102654 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:43.131795 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] MFA Rules not processed for user `4c0eae671ea443359249178345d7899f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:43.133282 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:43.207215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:43.217255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1267/2558] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:43.229098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:43.231907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:43.297073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d058d1-05f4-4a35-bbda-e5b074dba6e4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:43.301153 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:43.301774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:43.302084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:43.302367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:43.312070 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:43.313516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:43.318545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:43.324957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1292/2559] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:43.493381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:43.503377 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268564-bde6-4e52-838a-ad474f6e2562 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:43.507331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e80f-375b-4042-aa10-0e225de3bbfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:43.507938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e80f-375b-4042-aa10-0e225de3bbfa service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:43.508222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e80f-375b-4042-aa10-0e225de3bbfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:43.508494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e80f-375b-4042-aa10-0e225de3bbfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:43.582765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03e80f-375b-4042-aa10-0e225de3bbfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:43.585069 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03e80f-375b-4042-aa10-0e225de3bbfa service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:43.594578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1268/2560] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:44.108090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:44.172260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c0a84-9930-4968-9549-da77dfb5a891 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:44.185827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:44.185827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:44.185827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:44.185827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] PATH_INFO: `/v3/users/dc50f4071dfa4254a1a54e0206589524` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:44.186423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc50f4071dfa4254a1a54e0206589524)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:44.186423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:44.187312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989500-a329-4791-a800-4c58c66aee32 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:44.187593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989500-a329-4791-a800-4c58c66aee32 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:44.187864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a989500-a329-4791-a800-4c58c66aee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:44.207485 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6a989500-a329-4791-a800-4c58c66aee32 None None] MFA Rules not processed for user `b041a3806ef04fc080c15b838e81b6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:44.209232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6a989500-a329-4791-a800-4c58c66aee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:44.265084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1269/2561] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:43:44.371828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc50f4071dfa4254a1a54e0206589524'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:44.442396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc50f4071dfa4254a1a54e0206589524'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:44.443704 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc50f4071dfa4254a1a54e0206589524'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:44.456756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc50f4071dfa4254a1a54e0206589524'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:44.457436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc50f4071dfa4254a1a54e0206589524'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:44.470466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1293/2562] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:44 2022] DELETE /identity/v3/users/dc50f4071dfa4254a1a54e0206589524 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:44.475707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:44.476056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:44.476393 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:44.495679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:44.496940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:44.558088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1270/2563] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:44.567653 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:44.569156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:44.582778 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:44.588935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:44.631569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673bbf0-9a08-4620-8c5b-b3cdfa40a5cc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:44.634214 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:44.635421 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:44.636287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:44.636567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:44.636897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:44.648624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:44.649040 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ad851-f093-41c6-87fb-d3f006587c84 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:44.650511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:44.652997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:44.653729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:44.654048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:44.654325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:44.656158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:44.661423 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1294/2564] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:44.666930 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:44.668371 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:44.677088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1271/2565] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:43:45.125990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:45.132724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:45.142954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352141cc-b3fc-46df-b3cc-3e60ce51d05a service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:45.148297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:45.148980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:45.149262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:45.149546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] PATH_INFO: `/v3/projects/12cc282679e147239ad8706727472ff1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:45.150915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cc282679e147239ad8706727472ff1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:45.155437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:45.175752 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:45.261362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cc282679e147239ad8706727472ff1', 'request_id': 'req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.266828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cc282679e147239ad8706727472ff1', 'request_id': 'req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.339948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cc282679e147239ad8706727472ff1', 'request_id': 'req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.352499 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] The token cache is being invalidate because project 12cc282679e147239ad8706727472ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:45.352789 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.353440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.355103 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1295/2566] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:45 2022] DELETE /identity/v3/projects/12cc282679e147239ad8706727472ff1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:45.359646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:45.372345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e54ba8-f4f2-4e96-88cd-9ae0f3bdb20b service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:45.435344 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:45.436272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:45.436558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:45.436833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] PATH_INFO: `/v3/users/4c0eae671ea443359249178345d7899f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:45.438190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0eae671ea443359249178345d7899f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:45.440286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:45.581692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0eae671ea443359249178345d7899f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.582368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0eae671ea443359249178345d7899f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.582973 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0eae671ea443359249178345d7899f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.591883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0eae671ea443359249178345d7899f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.603446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0fa7f69e-af3b-4f19-aa8f-4648bfaa7175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0eae671ea443359249178345d7899f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:45.677068 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1272/2567] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:43:45 2022] DELETE /identity/v3/users/4c0eae671ea443359249178345d7899f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:46.073638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.075084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:46.089187 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9e1dd-fa0a-4dd0-b538-5df9dd3e2715 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.158234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.158883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.159736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.159736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] PATH_INFO: `/v3/projects/2734a76719a5419db37653cae98f59de` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.160654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2734a76719a5419db37653cae98f59de)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:46.163484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:46.254838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2734a76719a5419db37653cae98f59de', 'request_id': 'req-54b10347-ffe9-437b-8eef-220d8bf6a721'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:46.260928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2734a76719a5419db37653cae98f59de', 'request_id': 'req-54b10347-ffe9-437b-8eef-220d8bf6a721'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:46.397088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2734a76719a5419db37653cae98f59de', 'request_id': 'req-54b10347-ffe9-437b-8eef-220d8bf6a721'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:46.409014 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] The token cache is being invalidate because project 2734a76719a5419db37653cae98f59de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:43:46.409305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:46.409973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-54b10347-ffe9-437b-8eef-220d8bf6a721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:43:46.411488 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1296/2568] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:43:46 2022] DELETE /identity/v3/projects/2734a76719a5419db37653cae98f59de => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:43:46.418046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.418343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.418619 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.439330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:46.440570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:46.501917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1273/2569] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:46.510057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.510350 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.510628 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.530974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:46.532256 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:46.541004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1297/2570] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:46.545328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.550306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:46.555788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a93ee-38fd-45f0-855f-57a8701b50a7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.560343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.560935 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.561218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.561760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.562199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:43:46.562501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:46.564122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:46.575819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1274/2571] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:43:46.580239 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.590013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40320abb-b460-4a5b-9409-ee3afffc8319 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.594815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.595409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.595692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.595967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.596599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:46.598547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:46.691217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1298/2572] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:43:46 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:46.696269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.706224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f7c43-c2a7-4a5a-ad7f-b11233814ef4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.765752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.766389 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.766669 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.766942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.767562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:46.769448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:46.877905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1275/2573] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:43:46 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:43:46.882863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.889781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:46.893768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e936f-922b-43ae-99e6-3c41c41d4a89 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.901366 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.902117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.902779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.902779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.903429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:46.905260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:46.917819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1299/2574] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:46.922738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.934593 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84142a41-9ce1-4ae5-9f5d-edceab0970c4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.941099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5741c1-9c8d-4bb1-962b-355b8d8c74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.942210 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5741c1-9c8d-4bb1-962b-355b8d8c74ee admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.942591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5741c1-9c8d-4bb1-962b-355b8d8c74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.943027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5741c1-9c8d-4bb1-962b-355b8d8c74ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:46.944105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5741c1-9c8d-4bb1-962b-355b8d8c74ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:46.946383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5741c1-9c8d-4bb1-962b-355b8d8c74ee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:46.960632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1276/2575] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:43:46.965681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:46.980636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d7ce-0894-4f87-bfa2-98636eea2805 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:46.986438 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:46.988815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:46.988815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:46.988815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] PATH_INFO: `/v3/projects/d6f358876b1148cc9cb2c58d759f5658/users/d9ee05c31caa4531893a060e2b9b1dd5/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:47.005548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f358876b1148cc9cb2c58d759f5658, user_id=d9ee05c31caa4531893a060e2b9b1dd5, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:47.008845 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:47.127440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1300/2576] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:43:46 2022] PUT /identity/v3/projects/d6f358876b1148cc9cb2c58d759f5658/users/d9ee05c31caa4531893a060e2b9b1dd5/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:43:47.139208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:47.139891 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:47.140185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:47.170379 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] MFA Rules not processed for user `d9ee05c31caa4531893a060e2b9b1dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:47.171597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:47.248892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1277/2577] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:43:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:47.261882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:47.263907 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:47.328249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b937d-7d3a-4eb3-a170-7bb8c7e263cd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:47.332769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:47.335183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:47.335183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:47.335183 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:47.345441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:47.346920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:47.367158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1301/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:49.034040 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:49.035580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:49.097316 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:49.118407 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb64935-26b9-41a5-b499-5f9b143f67d9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:49.124233 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:49.124847 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:49.125155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:49.125425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:49.128313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:49.143237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:49.151662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:49.163597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1278/2579] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:53.952658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:53.954218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:53.973038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f5251-ee6f-4fa8-8bf1-14a109c43569 service glance] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:53.979918 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:53.980590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:53.980901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:53.981176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:53.983257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:53.998156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:53.999766 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:54.012106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1302/2580] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:58.108125 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:58.120900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e3dec-c4f5-4daa-b2f2-a51dad861052 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:58.130667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:58.134003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:58.134003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:58.134003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:58.134448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:58.149731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:58.152476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3a8d-58c4-4840-905d-ff236d6766d5 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:58.164340 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1279/2581] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:04.006381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:08.159969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=14 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:11.422571 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:11.525087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298898-32d7-4c71-b9fe-0ae87246ef5b service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:11.530046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:11.530617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:11.530897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:11.531172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] PATH_INFO: `/v3/users/d9ee05c31caa4531893a060e2b9b1dd5` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:11.532315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ee05c31caa4531893a060e2b9b1dd5)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:11.534261 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:11.708176 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ee05c31caa4531893a060e2b9b1dd5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:11.762224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ee05c31caa4531893a060e2b9b1dd5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:11.763077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ee05c31caa4531893a060e2b9b1dd5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:11.777003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ee05c31caa4531893a060e2b9b1dd5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:11.777723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ee05c31caa4531893a060e2b9b1dd5'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:11.789810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1303/2582] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:11 2022] DELETE /identity/v3/users/d9ee05c31caa4531893a060e2b9b1dd5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:11.795198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:11.795700 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:11.795805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:11.846041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:11.847295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:11.906232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1280/2583] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:11.916090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:11.918211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:11.960569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:12.014454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369be0e4-6f73-44fd-8628-6e3aef6e068a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:12.018158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb9f04-648c-47ca-8512-645f0ff07ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:12.018764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9f04-648c-47ca-8512-645f0ff07ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:12.019047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9f04-648c-47ca-8512-645f0ff07ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:12.019321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9f04-648c-47ca-8512-645f0ff07ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:12.029269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9f04-648c-47ca-8512-645f0ff07ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:12.033479 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9f04-648c-47ca-8512-645f0ff07ea4 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:12.040180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1304/2584] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:12.461053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:12.462588 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:12.477711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940dabd-c951-4015-a688-7c6aabd346c9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:12.483713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:12.484364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:12.484653 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:12.484993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] PATH_INFO: `/v3/projects/d6f358876b1148cc9cb2c58d759f5658` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:12.486225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f358876b1148cc9cb2c58d759f5658)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:12.488372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:12.602375 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f358876b1148cc9cb2c58d759f5658', 'request_id': 'req-2f704694-08a4-4f27-98e1-0774ba298cd2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:12.608960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f358876b1148cc9cb2c58d759f5658', 'request_id': 'req-2f704694-08a4-4f27-98e1-0774ba298cd2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:12.699650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f358876b1148cc9cb2c58d759f5658', 'request_id': 'req-2f704694-08a4-4f27-98e1-0774ba298cd2'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:12.714395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] The token cache is being invalidate because project d6f358876b1148cc9cb2c58d759f5658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:12.714395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:12.714395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-2f704694-08a4-4f27-98e1-0774ba298cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:12.714395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1281/2585] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:12 2022] DELETE /identity/v3/projects/d6f358876b1148cc9cb2c58d759f5658 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:12.719287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:12.719767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:12.719882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:12.770625 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:12.771839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:12.831234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1305/2586] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:12.839190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:12.839692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:12.839791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:12.859905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:12.861100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:12.869338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1282/2587] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:12.874275 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:12.883922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a048bc1-8ec6-485f-80f3-ebd29fc2b974 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:12.888728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:12.889326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:12.889608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:12.889913 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:12.890567 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:12.890871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:12.892460 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:12.904125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1306/2588] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:12.908201 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:12.917890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abb1d4-5187-4672-90c2-0eee3ec9cbc6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:12.922510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:12.923105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:12.923386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:12.923666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:12.924287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:12.926202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:13.026565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1283/2589] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:12 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:13.030837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:13.040630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ca69-acb7-402d-8244-9c5da144cbbc admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:13.096936 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:13.097543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:13.097824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:13.098197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:13.098817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:13.100791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:13.179393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:13.186112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1307/2590] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:13 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:13.190181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:13.201314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d85a-c432-4e35-a9e9-cd722df93b18 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:13.205969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:13.206650 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:13.206931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:13.207208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:13.207851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:13.209500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:13.219391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1284/2591] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:13.225157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:13.235715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3440997-d757-47ac-8901-c7b0d8d1ab31 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:13.240492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613082c5-ab45-4789-8562-da75e433fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:13.240988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613082c5-ab45-4789-8562-da75e433fc58 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:13.241491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613082c5-ab45-4789-8562-da75e433fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:13.242012 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613082c5-ab45-4789-8562-da75e433fc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:13.242755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613082c5-ab45-4789-8562-da75e433fc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:13.245354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613082c5-ab45-4789-8562-da75e433fc58 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:13.256351 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1308/2592] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:13.261668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:13.271946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c533c9f-0db8-42a4-8fe0-74283a93ee0c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:13.276881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:13.277466 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:13.277754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:13.278062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] PATH_INFO: `/v3/projects/6af540488ab54c22abc94c755f826c6f/users/b5de978daf234e6c9e56ba008eace1eb/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:13.281097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:13.292821 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af540488ab54c22abc94c755f826c6f, user_id=b5de978daf234e6c9e56ba008eace1eb, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:13.295604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:13.368257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1285/2593] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:13 2022] PUT /identity/v3/projects/6af540488ab54c22abc94c755f826c6f/users/b5de978daf234e6c9e56ba008eace1eb/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:13.380607 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:13.380901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:13.381181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:13.412416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] MFA Rules not processed for user `b5de978daf234e6c9e56ba008eace1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:13.413637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:13.482989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1309/2594] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:13.494173 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:13.496590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:13.583618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2940bf-c1f4-42ed-9e54-1d8718a5186e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:13.587487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:13.588212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:13.589073 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:13.589357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:13.598249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:13.599637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:13.608923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1286/2595] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:21.994934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:21.997043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:22.055016 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b286058-d8ac-4a92-b6a1-162699e9c9b4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:22.062973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:22.062973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:22.062973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:22.062973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:22.063414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:22.136843 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:22.138325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:22.148521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1310/2596] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:23.604894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:25.820291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:25.820291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:25.899131 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080aeb-81bf-4337-8995-4fef8825df6f service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:25.904425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:25.905031 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:25.905310 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:25.905596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:25.907452 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:25.919171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:25.920769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:25.928604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:25.930748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:25.931745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1287/2597] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:25.944314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e491d-f931-403b-906b-6b22a4e2ba9a service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:25.948970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:25.950379 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:25.950881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:25.951196 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] PATH_INFO: `/v3/users/f4266683d5cd4716b33df6377ffa498b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:25.952761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4266683d5cd4716b33df6377ffa498b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:25.954832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:25.980547 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:26.148282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4266683d5cd4716b33df6377ffa498b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.224447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4266683d5cd4716b33df6377ffa498b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.225064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4266683d5cd4716b33df6377ffa498b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.237966 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4266683d5cd4716b33df6377ffa498b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.238598 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-168337db-98b4-472e-9dfe-a3d979c6a57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4266683d5cd4716b33df6377ffa498b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.251005 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1311/2598] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:25 2022] DELETE /identity/v3/users/f4266683d5cd4716b33df6377ffa498b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:26.589728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:26.614188 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baa52c-99ef-4e33-8673-2a35e06aea85 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:26.684879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:26.685622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:26.685941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:26.686223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] PATH_INFO: `/v3/projects/72f810cccc984a7a9859f8fce50d2002` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:26.687362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f810cccc984a7a9859f8fce50d2002)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:26.689279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:26.801586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f810cccc984a7a9859f8fce50d2002', 'request_id': 'req-f1123cee-2f48-47f3-a551-d08eaa6d7e45'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.807222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f810cccc984a7a9859f8fce50d2002', 'request_id': 'req-f1123cee-2f48-47f3-a551-d08eaa6d7e45'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.897595 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f810cccc984a7a9859f8fce50d2002', 'request_id': 'req-f1123cee-2f48-47f3-a551-d08eaa6d7e45'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.911319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] The token cache is being invalidate because project 72f810cccc984a7a9859f8fce50d2002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:26.911676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.912418 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f1123cee-2f48-47f3-a551-d08eaa6d7e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:26.914199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1288/2599] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:26 2022] DELETE /identity/v3/projects/72f810cccc984a7a9859f8fce50d2002 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:26.919233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:26.919611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:26.920138 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:26.940270 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:26.941484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:27.003798 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1312/2600] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:44:27.013373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.013696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.014224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.035140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:27.036351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:27.044633 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1289/2601] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:27.049041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.058924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98242-fc2e-46ae-8185-c0acb3f789f8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.063997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.064611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.064912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.065167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.065814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:27.066151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.067806 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.080741 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1313/2602] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:27.085219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.095305 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167773b-23dc-4089-b71a-503aefd88f75 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.099963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.100567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.100853 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.101117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.101739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.103661 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.115689 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:27.238284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1290/2603] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:27 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:27.242566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.253590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1c2ee-3650-49f2-8105-68f7721143fa admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.319377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.320053 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.320280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.320554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.321201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.323157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.412969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1314/2604] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:27 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:27.417425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.429227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f7b30-4090-49c9-a300-ef58a1a5bdeb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.434111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.435422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.435944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.436088 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.436927 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.438601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.448751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1291/2605] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:27.453034 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.463144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40f9f3-401a-46d9-9862-15c1baf07dbd admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.468706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001115-af0b-4ae4-b5b5-1b0c976049c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.469502 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001115-af0b-4ae4-b5b5-1b0c976049c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.469675 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001115-af0b-4ae4-b5b5-1b0c976049c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.469993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001115-af0b-4ae4-b5b5-1b0c976049c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.470640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001115-af0b-4ae4-b5b5-1b0c976049c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.472230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001115-af0b-4ae4-b5b5-1b0c976049c5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.483779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1315/2606] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:27.488058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.497993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361ea57-10af-4eb9-becc-f58f6706fd83 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.502645 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.503289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.503568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.503843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] PATH_INFO: `/v3/projects/060ccb65f7b94a8ea416633fcf9803c9/users/83b5ea36020b4b4d8b5866a005fc9676/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.518704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] RBAC: Authorizing `identity:create_grant(project_id=060ccb65f7b94a8ea416633fcf9803c9, user_id=83b5ea36020b4b4d8b5866a005fc9676, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.521433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.584426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1292/2607] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:27 2022] PUT /identity/v3/projects/060ccb65f7b94a8ea416633fcf9803c9/users/83b5ea36020b4b4d8b5866a005fc9676/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:27.596067 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.596360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.596641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.604734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:27.626199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] MFA Rules not processed for user `83b5ea36020b4b4d8b5866a005fc9676`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:27.627691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:27.695780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1316/2608] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:27.700295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.762771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2783-1aaf-4095-9fcc-b8be91f9777b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.768187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.768813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.769094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.769366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.770027 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.772028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:27.911881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1293/2609] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:27 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:27.913320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:27.925309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257eff9-bf55-4e18-8231-f118c79ce5d5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:27.988481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:27.989215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:27.989367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:27.989639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:27.990314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:27.992229 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:28.068726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1317/2610] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:27 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:44:28.069936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:28.081902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e3453-687c-4571-8421-38efefe6d316 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:28.086656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:28.092818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.092818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.092818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.092818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:28.092818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:28.105160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1294/2611] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:28.106796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:28.116824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf011e0-608a-475b-8a1c-46e6dcf88668 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:28.121403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:28.127736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.127736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.127736 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] PATH_INFO: `/v3/projects/bdeb2bdb33c24ebb9bc9e4f4e248cd66/users/1d114f826e99459c966a5eccae134d87/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.139976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdeb2bdb33c24ebb9bc9e4f4e248cd66, user_id=1d114f826e99459c966a5eccae134d87, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:28.142680 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:28.196087 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1318/2612] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:28 2022] PUT /identity/v3/projects/bdeb2bdb33c24ebb9bc9e4f4e248cd66/users/1d114f826e99459c966a5eccae134d87/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:28.200024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:28.210662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdf17b-4d72-49a3-8673-e36e2d5a6d5a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:28.269880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01380328-4357-4949-82c0-dc2b874bb91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:28.270518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01380328-4357-4949-82c0-dc2b874bb91f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.270799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01380328-4357-4949-82c0-dc2b874bb91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.271071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01380328-4357-4949-82c0-dc2b874bb91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.271705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01380328-4357-4949-82c0-dc2b874bb91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:28.273279 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01380328-4357-4949-82c0-dc2b874bb91f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:28.283238 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1295/2613] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:28.287711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:28.298237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbde852-325c-420c-bfe5-fcb719e850f2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:28.302830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:28.303514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.303792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.304068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] PATH_INFO: `/v3/projects/bdeb2bdb33c24ebb9bc9e4f4e248cd66/users/1d114f826e99459c966a5eccae134d87/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.306193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdeb2bdb33c24ebb9bc9e4f4e248cd66, user_id=1d114f826e99459c966a5eccae134d87, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:28.309022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:28.320937 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1319/2614] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:28 2022] PUT /identity/v3/projects/bdeb2bdb33c24ebb9bc9e4f4e248cd66/users/1d114f826e99459c966a5eccae134d87/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:44:28.331876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.332167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.332444 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.360651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] MFA Rules not processed for user `1d114f826e99459c966a5eccae134d87`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:28.361848 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:28.374985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:28.429766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1296/2615] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:28.441330 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:28.443095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:28.509398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:28.515146 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3867059-9db3-4c97-b6d6-ec74c71ce487 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:28.518629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec7678-6258-45cb-b801-98533cc7d470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:28.519251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec7678-6258-45cb-b801-98533cc7d470 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.519532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec7678-6258-45cb-b801-98533cc7d470 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.519935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec7678-6258-45cb-b801-98533cc7d470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.529963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec7678-6258-45cb-b801-98533cc7d470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:28.531422 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec7678-6258-45cb-b801-98533cc7d470 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:28.541263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1320/2616] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:28 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:28.747606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:28.811028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9c2c-3c9c-4e59-8216-cc8f1e65787f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:28.815677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:28.816313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:28.816591 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:28.816865 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] PATH_INFO: `/v3/users/83b5ea36020b4b4d8b5866a005fc9676` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:28.818015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b5ea36020b4b4d8b5866a005fc9676)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:28.819941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:29.015149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b5ea36020b4b4d8b5866a005fc9676'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:29.015742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b5ea36020b4b4d8b5866a005fc9676'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:29.016346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b5ea36020b4b4d8b5866a005fc9676'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:29.024175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b5ea36020b4b4d8b5866a005fc9676'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:29.036899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b5ea36020b4b4d8b5866a005fc9676'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:29.146849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1297/2617] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:28 2022] DELETE /identity/v3/users/83b5ea36020b4b4d8b5866a005fc9676 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:29.150498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:29.151019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:29.151142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:29.170510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:29.171737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:29.238157 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1321/2618] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:44:29.249134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:29.250861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:29.286274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:29.309696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75946e17-fbe5-4d64-ae01-3b025bbec4bb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:29.315111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:29.315954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:29.316616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:29.316944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:29.326059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:29.328830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:29.338306 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1298/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:29.843397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:29.844828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:29.858722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479b106-20bc-4c8d-8c6a-ca2a0090df18 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:29.863352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:29.866831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:29.866831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:29.866831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] PATH_INFO: `/v3/projects/060ccb65f7b94a8ea416633fcf9803c9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:29.866831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=060ccb65f7b94a8ea416633fcf9803c9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:29.868317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:29.997832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060ccb65f7b94a8ea416633fcf9803c9', 'request_id': 'req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.005318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060ccb65f7b94a8ea416633fcf9803c9', 'request_id': 'req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.098520 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060ccb65f7b94a8ea416633fcf9803c9', 'request_id': 'req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.111378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] The token cache is being invalidate because project 060ccb65f7b94a8ea416633fcf9803c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:30.111702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.112383 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.114195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1322/2620] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:29 2022] DELETE /identity/v3/projects/060ccb65f7b94a8ea416633fcf9803c9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:30.118449 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:30.131995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19fdad-74bf-4f6f-9c13-6138fda3f864 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:30.191779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:30.192412 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:30.192695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:30.192969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] PATH_INFO: `/v3/users/1d114f826e99459c966a5eccae134d87` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:30.194162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d114f826e99459c966a5eccae134d87)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:30.196075 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:30.399446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d114f826e99459c966a5eccae134d87'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.400157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d114f826e99459c966a5eccae134d87'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.400823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d114f826e99459c966a5eccae134d87'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.408835 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d114f826e99459c966a5eccae134d87'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.421098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-8fb667f1-035c-4421-a653-18dff30f3985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d114f826e99459c966a5eccae134d87'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:30.505137 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1299/2621] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:30 2022] DELETE /identity/v3/users/1d114f826e99459c966a5eccae134d87 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:30.959223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:30.960747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:30.977672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f8ea-6c20-4477-bdae-b1cd914121eb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.033695 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.034384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.034667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.034946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] PATH_INFO: `/v3/projects/bdeb2bdb33c24ebb9bc9e4f4e248cd66` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.036105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdeb2bdb33c24ebb9bc9e4f4e248cd66)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.038466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.055815 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:31.197535 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdeb2bdb33c24ebb9bc9e4f4e248cd66', 'request_id': 'req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:31.205510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdeb2bdb33c24ebb9bc9e4f4e248cd66', 'request_id': 'req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:31.281341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdeb2bdb33c24ebb9bc9e4f4e248cd66', 'request_id': 'req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:31.293058 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] The token cache is being invalidate because project bdeb2bdb33c24ebb9bc9e4f4e248cd66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:31.293347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:31.294003 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ebd73c91-ac73-4930-b5e4-c5cedc45fdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:31.295487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1323/2622] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:30 2022] DELETE /identity/v3/projects/bdeb2bdb33c24ebb9bc9e4f4e248cd66 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:31.302520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.303250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.303250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.324663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:31.325899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:31.381603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:31.394721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1300/2623] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:31.406772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.407145 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.407557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.430884 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:31.432097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:31.441182 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1324/2624] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:31.445563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:31.455868 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5df1a-9392-4e2c-81e6-7267717df05b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.461562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.462227 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.462520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.462799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.463479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:31.463796 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.465438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.479243 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1301/2625] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:31.484637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:31.494038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c2464-c238-4bc8-8f75-635fc19d76d1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.500462 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.501093 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.501532 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.502285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.502665 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.504767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.592165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1325/2626] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:31 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:44:31.596787 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:31.607842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e481c-d66f-4deb-a530-a2c10f0f6f8c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.674926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.675172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.675257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.675546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.676259 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.678221 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.768726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1302/2627] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:31 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:31.772853 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:31.783962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae180b-3e8a-4ecc-8fc9-b2126275f941 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.788747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.789363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.789639 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.789947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.790595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.792198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.804701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1326/2628] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:31.809010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:31.819949 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e552c-c0e4-4b1b-ad37-5c6f5d53ea4f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.825255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421098e-eab1-4bc7-99ca-eb3204a0e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.825902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421098e-eab1-4bc7-99ca-eb3204a0e80d admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.826196 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421098e-eab1-4bc7-99ca-eb3204a0e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.826472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421098e-eab1-4bc7-99ca-eb3204a0e80d admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.827734 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421098e-eab1-4bc7-99ca-eb3204a0e80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.829352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421098e-eab1-4bc7-99ca-eb3204a0e80d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.842861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1303/2629] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:31.847189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:31.857828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822796de-12c3-47c9-9c52-f3a269fee880 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:31.863173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:31.863895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.864203 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.864489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] PATH_INFO: `/v3/projects/5745b67090914c1cb0674100ab41dbc9/users/3fd0ba87701c4db7831eb5beb659858d/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:31.886521 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5745b67090914c1cb0674100ab41dbc9, user_id=3fd0ba87701c4db7831eb5beb659858d, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:31.889238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:31.991692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1327/2630] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:31 2022] PUT /identity/v3/projects/5745b67090914c1cb0674100ab41dbc9/users/3fd0ba87701c4db7831eb5beb659858d/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:31.996942 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa41ca-99c8-4528-90ca-16af2fc1dca0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:31.997232 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa41ca-99c8-4528-90ca-16af2fc1dca0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:31.997510 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa41ca-99c8-4528-90ca-16af2fc1dca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:32.017923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8cfa41ca-99c8-4528-90ca-16af2fc1dca0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:32.019168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8cfa41ca-99c8-4528-90ca-16af2fc1dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:32.082899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1304/2631] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:32.092611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:32.095092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:32.155745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803641-bef3-41fe-95f7-8ff86e38a2b0 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:32.159485 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:32.160090 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:32.160373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:32.160650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:32.170243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:32.172055 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:32.183872 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1328/2632] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:33.384954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:33.385567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:33.385567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:33.414250 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] MFA Rules not processed for user `3fd0ba87701c4db7831eb5beb659858d`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:33.415458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:33.473482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:33.494465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1305/2633] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:33.499059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:33.511667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59462ac7-1f88-4aa9-a970-c873e7851ce1 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:33.519072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:33.519689 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:33.519973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:33.520247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:33.520899 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:33.522820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:33.619459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1329/2634] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:33 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:44:33.623607 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:33.635372 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ac8d2-f73d-4e5c-82d9-43e4278209f8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:33.695766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:33.701489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:33.701489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:33.701489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:33.701489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:33.701489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:33.787078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1306/2635] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:33 2022] POST /identity/v3/users => generated 308 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:33.790819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:33.802220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dec9e-c1cb-47f9-bcb5-f3a521a24f44 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:33.807162 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:33.807477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:33.807763 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:33.808036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:33.808683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:33.810322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:33.829414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1330/2636] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:33.837103 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:33.852067 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f58fe-5fcc-4a62-868e-6d4729ccf781 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:33.857090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:33.857746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:33.858050 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:33.858324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] PATH_INFO: `/v3/projects/d0a08decd23a4710bbe89d7c98410a1a/users/c956204e30de4e1a964c47faf344feee/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:33.876315 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a08decd23a4710bbe89d7c98410a1a, user_id=c956204e30de4e1a964c47faf344feee, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:33.879016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:33.944990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1307/2637] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:33 2022] PUT /identity/v3/projects/d0a08decd23a4710bbe89d7c98410a1a/users/c956204e30de4e1a964c47faf344feee/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:33.949139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:33.960235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e84dd-dc4a-42bc-8871-94ea08eb9636 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:33.965002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:34.020746 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79a092-11ed-43a7-b206-a9817931e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:34.021371 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a092-11ed-43a7-b206-a9817931e6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:34.021649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a092-11ed-43a7-b206-a9817931e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:34.021956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a092-11ed-43a7-b206-a9817931e6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:34.022627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79a092-11ed-43a7-b206-a9817931e6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:34.024216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79a092-11ed-43a7-b206-a9817931e6f4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:34.035441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1331/2638] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:34.039300 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:34.049423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868fe20-4c71-4112-9e0d-8fb22c5b60e2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:34.054252 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:34.054897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:34.055181 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:34.055455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] PATH_INFO: `/v3/projects/d0a08decd23a4710bbe89d7c98410a1a/users/c956204e30de4e1a964c47faf344feee/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:34.057554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a08decd23a4710bbe89d7c98410a1a, user_id=c956204e30de4e1a964c47faf344feee, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:34.060229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:34.076116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1308/2639] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:34 2022] PUT /identity/v3/projects/d0a08decd23a4710bbe89d7c98410a1a/users/c956204e30de4e1a964c47faf344feee/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:35.321611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:35.322137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:35.322339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:35.357109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] MFA Rules not processed for user `c956204e30de4e1a964c47faf344feee`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:35.358579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:35.439969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1332/2640] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:37.011328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:37.114280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1dc5-0add-4568-9035-4a950ea07b19 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:37.119126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:37.119807 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:37.120265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:37.120544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] PATH_INFO: `/v3/users/3fd0ba87701c4db7831eb5beb659858d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:37.121763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd0ba87701c4db7831eb5beb659858d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:37.124046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:37.345566 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:37.347875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd0ba87701c4db7831eb5beb659858d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:37.348561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd0ba87701c4db7831eb5beb659858d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:37.349184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd0ba87701c4db7831eb5beb659858d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:37.359570 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd0ba87701c4db7831eb5beb659858d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:37.375239 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd0ba87701c4db7831eb5beb659858d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:37.452763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1309/2641] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:37 2022] DELETE /identity/v3/users/3fd0ba87701c4db7831eb5beb659858d => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:37.914132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:37.924457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42332719-b8ef-428e-bc5a-11304e6700b1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:38.007511 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:38.008335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:38.008702 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:38.009085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] PATH_INFO: `/v3/projects/5745b67090914c1cb0674100ab41dbc9` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:38.010381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5745b67090914c1cb0674100ab41dbc9)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:38.012456 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:38.117343 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:38.130743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5745b67090914c1cb0674100ab41dbc9', 'request_id': 'req-8b59380d-b495-4d10-9779-a3bdca90f309'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.137774 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5745b67090914c1cb0674100ab41dbc9', 'request_id': 'req-8b59380d-b495-4d10-9779-a3bdca90f309'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.183408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5745b67090914c1cb0674100ab41dbc9', 'request_id': 'req-8b59380d-b495-4d10-9779-a3bdca90f309'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.204756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] The token cache is being invalidate because project 5745b67090914c1cb0674100ab41dbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:38.205051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.211104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.214761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1333/2642] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:37 2022] DELETE /identity/v3/projects/5745b67090914c1cb0674100ab41dbc9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:38.217312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:38.218936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:38.233009 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969ee4-0e04-41d7-80f2-e6843069808c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:38.302147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:38.305636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:38.305636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:38.305636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] PATH_INFO: `/v3/users/c956204e30de4e1a964c47faf344feee` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:38.305636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c956204e30de4e1a964c47faf344feee)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:38.306755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:38.488508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c956204e30de4e1a964c47faf344feee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.489256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c956204e30de4e1a964c47faf344feee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.489972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c956204e30de4e1a964c47faf344feee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.498436 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c956204e30de4e1a964c47faf344feee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.510629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-bfb5d812-9cda-48fd-bb4a-af46186841da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c956204e30de4e1a964c47faf344feee'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:38.596741 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1310/2643] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:38 2022] DELETE /identity/v3/users/c956204e30de4e1a964c47faf344feee => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:38.883987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:38.886722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:38.903708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59380d-b495-4d10-9779-a3bdca90f309 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:38.970075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:38.971492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:38.971857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:38.972609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] PATH_INFO: `/v3/projects/d0a08decd23a4710bbe89d7c98410a1a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:38.973445 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a08decd23a4710bbe89d7c98410a1a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:38.975926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.101166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a08decd23a4710bbe89d7c98410a1a', 'request_id': 'req-37b8db6a-ba5a-41b1-ae82-518854a22c6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:39.107296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a08decd23a4710bbe89d7c98410a1a', 'request_id': 'req-37b8db6a-ba5a-41b1-ae82-518854a22c6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:39.196171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a08decd23a4710bbe89d7c98410a1a', 'request_id': 'req-37b8db6a-ba5a-41b1-ae82-518854a22c6a'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:39.210193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] The token cache is being invalidate because project d0a08decd23a4710bbe89d7c98410a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:39.210552 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:39.211297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37b8db6a-ba5a-41b1-ae82-518854a22c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:39.212850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1334/2644] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:38 2022] DELETE /identity/v3/projects/d0a08decd23a4710bbe89d7c98410a1a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:39.218019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553811-9415-444d-94f9-111a318e369c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.218505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553811-9415-444d-94f9-111a318e369c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.218626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553811-9415-444d-94f9-111a318e369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.239057 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d5553811-9415-444d-94f9-111a318e369c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:39.240194 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d5553811-9415-444d-94f9-111a318e369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:39.276337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:39.302812 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1311/2645] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:39.311133 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.312298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.312646 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.335587 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:39.336802 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:39.345365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1335/2646] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:39.349916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553811-9415-444d-94f9-111a318e369c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:39.360168 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553811-9415-444d-94f9-111a318e369c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:39.365774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:39.366429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.366713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.366988 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.367679 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:39.367990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:39.369656 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.382554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1312/2647] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:39.387195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:39.398177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608aeb5-5f5c-4898-a401-2421a00332c2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:39.402962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:39.403562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.403855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.404114 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.404735 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:39.407126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.502719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1336/2648] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:39 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:44:39.505349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:39.522616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc734b-2044-4ae6-b1cf-534a55cc4c5f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:39.597133 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:39.597751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.598081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.598357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.598963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:39.600875 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.688640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1313/2649] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:39 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:39.692751 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:39.705341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b046f-fc50-468f-b044-dc6599648218 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:39.710310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:39.710935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.711216 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.711496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.712159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:39.713992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.725147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1337/2650] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:39.729236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:39.740932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e7b26-f0f1-47e5-8dd1-476430d86189 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:39.746716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad6f2-be07-4105-ae11-ba1e202a1e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:39.747534 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad6f2-be07-4105-ae11-ba1e202a1e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.747771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad6f2-be07-4105-ae11-ba1e202a1e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.748109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad6f2-be07-4105-ae11-ba1e202a1e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.748799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad6f2-be07-4105-ae11-ba1e202a1e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:39.750990 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad6f2-be07-4105-ae11-ba1e202a1e97 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.766355 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1314/2651] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:39.767430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:39.779776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7d466-cba7-497b-8d8d-6b5988f9422c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:39.785569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:39.786414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.786706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.786989 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] PATH_INFO: `/v3/projects/6075c7574cfb455f926c852676ce9da1/users/3aa2a67602fa4eb5ae3c3224d3cf314d/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.796912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:39.803999 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6075c7574cfb455f926c852676ce9da1, user_id=3aa2a67602fa4eb5ae3c3224d3cf314d, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:39.806793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:39.910641 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1338/2652] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:39 2022] PUT /identity/v3/projects/6075c7574cfb455f926c852676ce9da1/users/3aa2a67602fa4eb5ae3c3224d3cf314d/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:39.922167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:39.922529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:39.922922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:39.955612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] MFA Rules not processed for user `3aa2a67602fa4eb5ae3c3224d3cf314d`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:39.956894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:40.049477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1315/2653] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:40.050876 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.125997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad864600-265a-449b-b91b-fccb74fa00e8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.130826 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.131459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.131758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.132027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.132683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.134655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.225042 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1339/2654] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:40 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:44:40.226668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.238283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387838a-a1c2-41a8-a7f1-2c77e2b60277 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.277893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:40.306404 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.307046 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.307332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.307604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.308437 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.310419 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.400388 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1316/2655] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:40 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:40.401617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.412372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bcf40-7aa7-47ee-93de-0d299f82b986 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.417452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.418300 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.418701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.418982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.419645 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.422044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.440367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1340/2656] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:44:40.442111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.454874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341936e-c850-42cc-aa8c-42cf8e1feee4 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.459751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.460501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.460833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.461141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] PATH_INFO: `/v3/projects/199752cd6d334e9fafcd2cf708ecb1e4/users/78669ecbd8894b669795cee81ccb91ef/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.479673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199752cd6d334e9fafcd2cf708ecb1e4, user_id=78669ecbd8894b669795cee81ccb91ef, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.484074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.581837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1317/2657] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:40 2022] PUT /identity/v3/projects/199752cd6d334e9fafcd2cf708ecb1e4/users/78669ecbd8894b669795cee81ccb91ef/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:44:40.585808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.597652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79949e64-8b28-49a7-b7f4-adb7be14c953 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.666404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb139e1-790b-4028-9e99-3d90fc48c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.667027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb139e1-790b-4028-9e99-3d90fc48c0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.667302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb139e1-790b-4028-9e99-3d90fc48c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.667578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb139e1-790b-4028-9e99-3d90fc48c0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.668234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb139e1-790b-4028-9e99-3d90fc48c0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.669825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb139e1-790b-4028-9e99-3d90fc48c0e9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.682897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1341/2658] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:40.687256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.699413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48c3a-a1f2-44fa-9ffd-5984c7d1f6d8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.704962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.705630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.705969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.706294 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] PATH_INFO: `/v3/projects/199752cd6d334e9fafcd2cf708ecb1e4/users/78669ecbd8894b669795cee81ccb91ef/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.708391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=199752cd6d334e9fafcd2cf708ecb1e4, user_id=78669ecbd8894b669795cee81ccb91ef, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.711082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.723529 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1318/2659] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:40 2022] PUT /identity/v3/projects/199752cd6d334e9fafcd2cf708ecb1e4/users/78669ecbd8894b669795cee81ccb91ef/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:40.735681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.735972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.736254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.765701 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] MFA Rules not processed for user `78669ecbd8894b669795cee81ccb91ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:40.766957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:40.819360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:40.845080 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1342/2660] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:40.857542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:40.860152 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:40.941612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81d38a-a16d-47a4-a6d4-ee81d7461fff admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:40.945502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6878-82f9-464b-aa38-1a366cda65dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:40.946164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6878-82f9-464b-aa38-1a366cda65dc service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:40.946446 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6878-82f9-464b-aa38-1a366cda65dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:40.946723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6878-82f9-464b-aa38-1a366cda65dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:40.957286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6878-82f9-464b-aa38-1a366cda65dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:40.958921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6878-82f9-464b-aa38-1a366cda65dc service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:40.969954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1319/2661] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:42.319497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:42.405927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678fe7f-704f-4b6b-bff6-48dadfd728c1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:42.410819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:42.411510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:42.411788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:42.412139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] PATH_INFO: `/v3/users/3aa2a67602fa4eb5ae3c3224d3cf314d` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:42.413247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa2a67602fa4eb5ae3c3224d3cf314d)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:42.416106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:42.599165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa2a67602fa4eb5ae3c3224d3cf314d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:42.680198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa2a67602fa4eb5ae3c3224d3cf314d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:42.680902 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa2a67602fa4eb5ae3c3224d3cf314d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:42.698037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa2a67602fa4eb5ae3c3224d3cf314d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:42.698947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa2a67602fa4eb5ae3c3224d3cf314d'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:42.716959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1343/2662] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:42 2022] DELETE /identity/v3/users/3aa2a67602fa4eb5ae3c3224d3cf314d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:42.723621 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:42.724160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:42.724160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:42.745898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:42.747245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:42.844182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1320/2663] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:42.856681 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:42.859957 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:42.938106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cdd9f-7809-4724-a481-0db6709d4ad9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:42.942065 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:42.942690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:42.942974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:42.943251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:42.957331 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:42.958847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:42.970000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1344/2664] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:43.428094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:43.429764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:43.452688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e145cc-64b7-425c-ae19-805470e42d15 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:43.461438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:43.461438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:43.461438 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:43.462373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] PATH_INFO: `/v3/projects/6075c7574cfb455f926c852676ce9da1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:43.463313 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6075c7574cfb455f926c852676ce9da1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:43.465322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:43.582186 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:43.603477 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6075c7574cfb455f926c852676ce9da1', 'request_id': 'req-25507b7d-db4d-47c1-a335-9bd4b905674d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:43.609969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6075c7574cfb455f926c852676ce9da1', 'request_id': 'req-25507b7d-db4d-47c1-a335-9bd4b905674d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:43.709496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6075c7574cfb455f926c852676ce9da1', 'request_id': 'req-25507b7d-db4d-47c1-a335-9bd4b905674d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:43.726762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] The token cache is being invalidate because project 6075c7574cfb455f926c852676ce9da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:43.727488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:43.728495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:43.730887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1321/2665] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:43 2022] DELETE /identity/v3/projects/6075c7574cfb455f926c852676ce9da1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:44:43.737457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:43.745013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:43.749051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f172b-9646-4036-92bf-167a90c8e24e service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:43.843579 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:43.856917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:43.856917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:43.856917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] PATH_INFO: `/v3/users/78669ecbd8894b669795cee81ccb91ef` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:43.856917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78669ecbd8894b669795cee81ccb91ef)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:43.856917 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:44.023281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78669ecbd8894b669795cee81ccb91ef'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:44.087210 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78669ecbd8894b669795cee81ccb91ef'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:44.087984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78669ecbd8894b669795cee81ccb91ef'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:44.101984 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78669ecbd8894b669795cee81ccb91ef'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:44.102781 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-3df4ae2e-c3f7-4f96-9d33-7e334f8657c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78669ecbd8894b669795cee81ccb91ef'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:44.117742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1345/2666] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:43 2022] DELETE /identity/v3/users/78669ecbd8894b669795cee81ccb91ef => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:44.774712 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:44.779773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:44.801518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25507b7d-db4d-47c1-a335-9bd4b905674d admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:44.871640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:44.872283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:44.872562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:44.872834 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] PATH_INFO: `/v3/projects/199752cd6d334e9fafcd2cf708ecb1e4` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:44.874059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=199752cd6d334e9fafcd2cf708ecb1e4)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:44.875952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:45.041662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199752cd6d334e9fafcd2cf708ecb1e4', 'request_id': 'req-9322cc8d-76cb-44b0-ba9d-f860c895b70d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:45.048969 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199752cd6d334e9fafcd2cf708ecb1e4', 'request_id': 'req-9322cc8d-76cb-44b0-ba9d-f860c895b70d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:45.132728 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199752cd6d334e9fafcd2cf708ecb1e4', 'request_id': 'req-9322cc8d-76cb-44b0-ba9d-f860c895b70d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:45.146884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] The token cache is being invalidate because project 199752cd6d334e9fafcd2cf708ecb1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:45.147263 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:45.148391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9322cc8d-76cb-44b0-ba9d-f860c895b70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:45.149980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1322/2667] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:44 2022] DELETE /identity/v3/projects/199752cd6d334e9fafcd2cf708ecb1e4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:45.156850 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.157892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.158358 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.188110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:45.189376 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:45.262888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1346/2668] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:45.271320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.271608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.271882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.292543 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:45.294182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:45.304586 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1323/2669] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:44:45.308878 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:45.319874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaa66-5f8d-4d8c-8959-d83a1f43d4b4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:45.326057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:45.327294 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.327576 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.327891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.328706 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:45.329199 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:45.331685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:45.346927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1347/2670] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:45.354535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:45.367267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721924b1-08d5-42d0-8d92-8f6751bdb3aa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:45.372910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:45.373611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.374455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.374636 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.375296 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:45.377352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:45.506283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1324/2671] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:45 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:45.507831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:45.528775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605fe7b-8fc6-4f92-8e4d-a4c20c1dc2e3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:45.540513 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:45.610637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:45.611255 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.611540 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.611832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.612474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:45.614452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:45.752640 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1348/2672] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:45 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:45.756665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:45.769646 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99655-59c1-449b-b980-5b438af1acca admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:45.776997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:45.778053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.778585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.779043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.780549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:45.782944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:45.801354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1325/2673] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:45.805471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:45.845262 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b5b8c-2587-4408-924e-c71e0889379f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:45.853489 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56dca-2e5e-472c-9bd2-5b4058c5b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:45.854027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56dca-2e5e-472c-9bd2-5b4058c5b93c admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.854481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56dca-2e5e-472c-9bd2-5b4058c5b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.854893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56dca-2e5e-472c-9bd2-5b4058c5b93c admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.856226 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56dca-2e5e-472c-9bd2-5b4058c5b93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:45.859054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56dca-2e5e-472c-9bd2-5b4058c5b93c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:45.876284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1349/2674] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:45.880573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:45.887024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:45.892841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cab152-9922-4ec2-866c-29c1a3a1302b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:45.897961 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:45.898676 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:45.898957 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:45.899224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] PATH_INFO: `/v3/projects/8969f0401d7b4336af02c595141fa0bc/users/23cbcb2a7cc846d19572c697cd07bae7/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:45.915427 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8969f0401d7b4336af02c595141fa0bc, user_id=23cbcb2a7cc846d19572c697cd07bae7, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:45.918109 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:46.024844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1326/2675] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:45 2022] PUT /identity/v3/projects/8969f0401d7b4336af02c595141fa0bc/users/23cbcb2a7cc846d19572c697cd07bae7/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:46.035697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:46.035993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:46.036241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:46.069996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] MFA Rules not processed for user `23cbcb2a7cc846d19572c697cd07bae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:46.071340 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:46.159059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1350/2676] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:44:46.174476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:46.176403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:46.275119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35f03-4cff-4295-89ee-e6a20bdc5b07 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:46.281351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0ad09-0d8c-4fac-a5c8-73ca1f9fc202 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bef04835da9e450da45248746bb28fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:46.287769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ad09-0d8c-4fac-a5c8-73ca1f9fc202 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:46.287769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ad09-0d8c-4fac-a5c8-73ca1f9fc202 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:46.287769 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0ad09-0d8c-4fac-a5c8-73ca1f9fc202 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:46.294166 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0ad09-0d8c-4fac-a5c8-73ca1f9fc202 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:46.296248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0ad09-0d8c-4fac-a5c8-73ca1f9fc202 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:46.308301 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1327/2677] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:47.631508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:47.633268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:47.726249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0998d5-5e3e-433d-8433-7c8ba98f3bd3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:47.732924 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:47.734117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:47.735283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:47.735563 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] PATH_INFO: `/v3/users/b5de978daf234e6c9e56ba008eace1eb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:47.737088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5de978daf234e6c9e56ba008eace1eb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:47.739142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:47.767894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:47.943952 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5de978daf234e6c9e56ba008eace1eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:48.019289 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5de978daf234e6c9e56ba008eace1eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:48.020056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5de978daf234e6c9e56ba008eace1eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:48.036317 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5de978daf234e6c9e56ba008eace1eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:48.037780 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5de978daf234e6c9e56ba008eace1eb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:48.061827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1351/2678] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:47 2022] DELETE /identity/v3/users/b5de978daf234e6c9e56ba008eace1eb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:48.063613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:48.064117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:48.064208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:48.085846 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:48.087115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:48.162934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1328/2679] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:48.177642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:48.182370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:48.252495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63ae68-0100-40e3-a162-e5084624ace6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:48.256767 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153008-b073-4847-a212-18367b2300d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:48.262477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153008-b073-4847-a212-18367b2300d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:48.262477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153008-b073-4847-a212-18367b2300d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:48.262477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153008-b073-4847-a212-18367b2300d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:48.272243 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153008-b073-4847-a212-18367b2300d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:48.273650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153008-b073-4847-a212-18367b2300d4 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:48.285412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1352/2680] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:44:48.821244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:48.822765 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:48.842236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0078-8dc9-4e1a-82b5-916e80498f59 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:48.848307 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:48.848968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:48.849254 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:48.849533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] PATH_INFO: `/v3/projects/6af540488ab54c22abc94c755f826c6f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:48.850911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af540488ab54c22abc94c755f826c6f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:48.852866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.010276 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af540488ab54c22abc94c755f826c6f', 'request_id': 'req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:49.016711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af540488ab54c22abc94c755f826c6f', 'request_id': 'req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:49.179015 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af540488ab54c22abc94c755f826c6f', 'request_id': 'req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:49.193673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] The token cache is being invalidate because project 6af540488ab54c22abc94c755f826c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:49.194802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:49.194802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-436b6a41-1b1b-49c0-a04c-0d08ec57beb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:49.196399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1329/2681] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:48 2022] DELETE /identity/v3/projects/6af540488ab54c22abc94c755f826c6f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:49.201991 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.202526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.202526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.222501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.223852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.289782 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1353/2682] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.298594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.299054 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.299600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.317996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:49.323839 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.325091 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.339718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1330/2683] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.349072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.359370 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9831529-50f2-4380-bc18-5d7f177e75e3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.364198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.364812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.365099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.365372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.366284 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.366601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.368274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.384437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1354/2684] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.389760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.399528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272fb42-e2ce-4691-b0f3-b9f1751114b2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.409118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.409118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.409118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.409118 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.409538 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.409970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.524683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1331/2685] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:49.529167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.541279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26603527-bea9-45f6-a78f-f347d15dedb5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.569691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:49.626610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.627536 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.627908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.628324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.629050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.631225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.728096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1355/2686] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:49.732883 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.745074 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae962c71-a5dc-4391-98fc-c20d060d4539 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.750770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.751413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.751692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.751963 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.752615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.754324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.771200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1332/2687] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:49.775631 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.786588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e71484-cbeb-4e26-aeb1-4e3607eac50c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.791427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09227fd3-8935-44de-8f6c-5cf0c00529af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.792033 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227fd3-8935-44de-8f6c-5cf0c00529af admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.792315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227fd3-8935-44de-8f6c-5cf0c00529af admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.792656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227fd3-8935-44de-8f6c-5cf0c00529af admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.793305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09227fd3-8935-44de-8f6c-5cf0c00529af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.794928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09227fd3-8935-44de-8f6c-5cf0c00529af admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.805558 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1356/2688] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:49.809938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.821887 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f301f10-7ebc-4f9d-9acf-cc1196cf8c04 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.827788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.828596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.828881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.829158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] PATH_INFO: `/v3/projects/46adbfe9261e4fb0aa9fed3dba6c33ff/users/3eab3fa7fa104a9d9cdcdbae7502d9d6/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.847111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46adbfe9261e4fb0aa9fed3dba6c33ff, user_id=3eab3fa7fa104a9d9cdcdbae7502d9d6, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.849811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.960830 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1333/2689] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:49 2022] PUT /identity/v3/projects/46adbfe9261e4fb0aa9fed3dba6c33ff/users/3eab3fa7fa104a9d9cdcdbae7502d9d6/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:49.966368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ab4f0-710c-4dab-b430-8e3b827ac694 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.971339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ab4f0-710c-4dab-b430-8e3b827ac694 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.971339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ab4f0-710c-4dab-b430-8e3b827ac694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.989237 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ec2ab4f0-710c-4dab-b430-8e3b827ac694 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:50.008685 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ec2ab4f0-710c-4dab-b430-8e3b827ac694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:50.055719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1357/2690] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:50.067281 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.069362 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:50.134474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225cb38-e856-4763-b267-b3d24f30add0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.139428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1f19c-f89c-44e0-acac-79319f8d51ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.140049 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f19c-f89c-44e0-acac-79319f8d51ea service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.140329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f19c-f89c-44e0-acac-79319f8d51ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.140603 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f19c-f89c-44e0-acac-79319f8d51ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.152113 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1f19c-f89c-44e0-acac-79319f8d51ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.153601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1f19c-f89c-44e0-acac-79319f8d51ea service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.167494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1334/2691] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:51.394778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.395342 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.395606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.423523 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] MFA Rules not processed for user `b041a3806ef04fc080c15b838e81b6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.424797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.505347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1358/2692] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.689525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19c50-3010-427f-9e4b-8c9c5558a9f5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.692431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19c50-3010-427f-9e4b-8c9c5558a9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.692431 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19c50-3010-427f-9e4b-8c9c5558a9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.735572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-55c19c50-3010-427f-9e4b-8c9c5558a9f5 None None] MFA Rules not processed for user `3eab3fa7fa104a9d9cdcdbae7502d9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.737365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55c19c50-3010-427f-9e4b-8c9c5558a9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.867432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1335/2693] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.881611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.883132 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.982397 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccf7f2-e5ba-43ef-bf9c-be3021232c3e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.989006 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.990019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.990457 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.990892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.002470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:52.006433 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.007935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.021914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1359/2694] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:44:55.015126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9008-ec0f-45cd-83d9-786d3aec9694 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:55.015736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9008-ec0f-45cd-83d9-786d3aec9694 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:55.015736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a9008-ec0f-45cd-83d9-786d3aec9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:55.035900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-375a9008-ec0f-45cd-83d9-786d3aec9694 None None] MFA Rules not processed for user `3eab3fa7fa104a9d9cdcdbae7502d9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:55.037110 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-375a9008-ec0f-45cd-83d9-786d3aec9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:55.044008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1336/2695] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:44:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:01.730040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:01.732037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:01.746827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b74903-5a65-4453-a069-61e6ce2c3cc0 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:01.760667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.761400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.761688 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.762050 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] PATH_INFO: `/v3/users/23cbcb2a7cc846d19572c697cd07bae7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.763928 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cbcb2a7cc846d19572c697cd07bae7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.766074 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:01.960100 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cbcb2a7cc846d19572c697cd07bae7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.039809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cbcb2a7cc846d19572c697cd07bae7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.039940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cbcb2a7cc846d19572c697cd07bae7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.053832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cbcb2a7cc846d19572c697cd07bae7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.054605 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cbcb2a7cc846d19572c697cd07bae7'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.067175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1360/2696] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:01 2022] DELETE /identity/v3/users/23cbcb2a7cc846d19572c697cd07bae7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:02.071773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.072297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.072297 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.093136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:02.094380 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:02.119426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:02.156257 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1337/2697] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:02.166170 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.167656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:02.229816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a6ad-a844-4dc8-95ad-37222206e055 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.233647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670b5a1-54bd-4d36-a81b-c1e29cbc2b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.234305 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b5a1-54bd-4d36-a81b-c1e29cbc2b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.234590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b5a1-54bd-4d36-a81b-c1e29cbc2b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.234874 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b5a1-54bd-4d36-a81b-c1e29cbc2b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.244443 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670b5a1-54bd-4d36-a81b-c1e29cbc2b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.245722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670b5a1-54bd-4d36-a81b-c1e29cbc2b26 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.256019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1361/2698] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:02.734521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.736535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:02.752273 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756aaf38-d6ef-4430-890b-315a1401dd9c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.758084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.758733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.759023 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.760359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] PATH_INFO: `/v3/projects/8969f0401d7b4336af02c595141fa0bc` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.761245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8969f0401d7b4336af02c595141fa0bc)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.764010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.882432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8969f0401d7b4336af02c595141fa0bc', 'request_id': 'req-84049b6f-eefe-440d-b629-251603e513b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.888525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8969f0401d7b4336af02c595141fa0bc', 'request_id': 'req-84049b6f-eefe-440d-b629-251603e513b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.973390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8969f0401d7b4336af02c595141fa0bc', 'request_id': 'req-84049b6f-eefe-440d-b629-251603e513b6'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.993878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] The token cache is being invalidate because project 8969f0401d7b4336af02c595141fa0bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:02.994203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.994877 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-84049b6f-eefe-440d-b629-251603e513b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:02.996925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1338/2699] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:02 2022] DELETE /identity/v3/projects/8969f0401d7b4336af02c595141fa0bc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:03.002728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.003311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.003311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.025588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:03.026969 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.141060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1362/2700] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:03.144489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.145484 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.145764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.171317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:03.175562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.182547 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1339/2701] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:03.187755 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.215321 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc369a4-21bb-4ea4-a939-ef687416141e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.222077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.224318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.224318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.224318 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.224630 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:03.224926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.227077 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.237281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:03.243372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1363/2702] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:03.256590 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.266667 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341ddd-2859-4dcb-b352-b44da0298ead None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.271697 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.272330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.272605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.272866 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.273601 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.275971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.369517 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1340/2703] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:03.373933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.385304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3230c6-b4ff-414b-84cd-e31b51277e5b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.450844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.451498 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.451856 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.452137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.452788 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.454891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.560527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1364/2704] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:03.565873 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.583819 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5382c52-def5-467e-9468-0ef6884fcca8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.592004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.593139 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.593655 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.594153 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.595244 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.597946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.610752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1341/2705] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:03.614865 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.625578 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100830-6b00-47c3-a2c8-a07bb20b6b8f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.632491 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812289c-859e-4f9f-bfd5-7a3443dc164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.633551 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812289c-859e-4f9f-bfd5-7a3443dc164d admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.634057 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812289c-859e-4f9f-bfd5-7a3443dc164d admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.634522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812289c-859e-4f9f-bfd5-7a3443dc164d admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.635627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812289c-859e-4f9f-bfd5-7a3443dc164d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.639637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812289c-859e-4f9f-bfd5-7a3443dc164d admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.656276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1365/2706] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:03.657902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.669002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f80f0-21b4-4f5e-9604-832a49793546 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.674989 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.676097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.676995 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.677120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] PATH_INFO: `/v3/projects/e5749429957946ab835258c4fc5bdbe1/users/8553d4b9a3f2457bba277d34418967b7/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.695455 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5749429957946ab835258c4fc5bdbe1, user_id=8553d4b9a3f2457bba277d34418967b7, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.698272 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.768177 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1342/2707] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:03 2022] PUT /identity/v3/projects/e5749429957946ab835258c4fc5bdbe1/users/8553d4b9a3f2457bba277d34418967b7/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:03.779664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.780154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.780621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.827088 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] MFA Rules not processed for user `8553d4b9a3f2457bba277d34418967b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:03.828464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.902692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1366/2708] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:03.907752 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.958932 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:03.972261 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5dc03-9e0d-475a-b918-1dffa3a7c352 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.977120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.985585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.985585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.985585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.985585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.985585 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.083395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1343/2709] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:04.089612 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.100248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1596-1128-4d69-b7d0-d5b8b1b996ae None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.160139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.160671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.160950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.161218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.162149 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.163854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.176611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:04.238184 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1367/2710] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:04.242225 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.254923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa297b6-8d29-46c8-829b-61da7f7d9830 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.260507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.261192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.261540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.261958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.262799 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.265406 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.277906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1344/2711] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:04.282214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.292857 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8109f-4d72-4365-9fcd-552b4f0282aa admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.298842 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342523d3-5107-4fbe-ab3e-05bbea0c8218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.299792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342523d3-5107-4fbe-ab3e-05bbea0c8218 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.300139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342523d3-5107-4fbe-ab3e-05bbea0c8218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.300503 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342523d3-5107-4fbe-ab3e-05bbea0c8218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.301349 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342523d3-5107-4fbe-ab3e-05bbea0c8218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.302927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342523d3-5107-4fbe-ab3e-05bbea0c8218 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.318025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1368/2712] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:04.321413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.333587 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036d288-9351-48b8-aa98-579d8ad8133c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.340008 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.340736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.341025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.341978 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] PATH_INFO: `/v3/projects/c91bff5570944d3c8d049ed53d118367/users/8753d3a946214811b5bcb0c4e324ca9e/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.360314 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91bff5570944d3c8d049ed53d118367, user_id=8753d3a946214811b5bcb0c4e324ca9e, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.363101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.477025 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1345/2713] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:04 2022] PUT /identity/v3/projects/c91bff5570944d3c8d049ed53d118367/users/8753d3a946214811b5bcb0c4e324ca9e/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:04.488550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.488797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.489082 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.522242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] MFA Rules not processed for user `8753d3a946214811b5bcb0c4e324ca9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:04.523481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.609181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1369/2714] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:04.615291 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.682761 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04fedf-c13b-4957-9840-f6da296e6a80 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.688345 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.688959 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.689246 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.689524 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.690207 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.692117 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.762750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1346/2715] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:04.767141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.785672 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a266f2-802d-44fc-b2eb-f69a7717dd22 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.870589 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.871658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.872174 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.873091 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.873987 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.876011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.990654 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1370/2716] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:04.994918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.010977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a30fe-f598-4a97-98d0-f63a6ef95651 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.017833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.018896 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.023580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.023580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.023580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.023580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.034502 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1347/2717] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:05.038674 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.049325 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba522d25-6e7b-420d-b8eb-fd182126e603 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.054051 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.054705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.055052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.055322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] PATH_INFO: `/v3/projects/87c594ad60f146f7b2a0fd2f84d108a3/users/0bece735e79a461f84acf4f5fe0c254b/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.071098 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c594ad60f146f7b2a0fd2f84d108a3, user_id=0bece735e79a461f84acf4f5fe0c254b, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.073950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.173273 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1371/2718] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:05 2022] PUT /identity/v3/projects/87c594ad60f146f7b2a0fd2f84d108a3/users/0bece735e79a461f84acf4f5fe0c254b/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:05.177329 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.188470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf289a-5ade-4e7a-bf60-a63ef23299a0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.254953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feed6fd-c98a-4610-bd09-510d6bcdfac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.255611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feed6fd-c98a-4610-bd09-510d6bcdfac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.255870 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feed6fd-c98a-4610-bd09-510d6bcdfac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.256143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feed6fd-c98a-4610-bd09-510d6bcdfac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.256788 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feed6fd-c98a-4610-bd09-510d6bcdfac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.258440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feed6fd-c98a-4610-bd09-510d6bcdfac0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.269171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1348/2719] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:05.273478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.284172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f0da-621a-470e-85d5-37fb457a033e admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.288765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.289434 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.289717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.290038 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] PATH_INFO: `/v3/projects/87c594ad60f146f7b2a0fd2f84d108a3/users/0bece735e79a461f84acf4f5fe0c254b/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.291938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c594ad60f146f7b2a0fd2f84d108a3, user_id=0bece735e79a461f84acf4f5fe0c254b, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.295316 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.305474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1372/2720] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:05 2022] PUT /identity/v3/projects/87c594ad60f146f7b2a0fd2f84d108a3/users/0bece735e79a461f84acf4f5fe0c254b/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:05.316569 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.316861 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.317141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.336652 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:05.345249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] MFA Rules not processed for user `0bece735e79a461f84acf4f5fe0c254b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:05.346509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.415648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1349/2721] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:05.428140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.430043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.468990 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:05.508570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5acb3e-0a27-43d8-abc4-b36c66dc693f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.512221 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.512825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.513281 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.514919 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.576107 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.577656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.587195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1373/2722] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:07.670018 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:07.676687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:07.683557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6f192-92ff-4613-9001-dc032a63c0ba None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:07.689958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:07.690640 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:07.690925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:07.691202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:07.757007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:07.758499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:07.771086 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1350/2723] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:09.590253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:09.602156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6913-ae90-4553-96ce-d147f7973216 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:09.607647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662a1f8-b1ac-4f59-9cdc-745c9d5dccbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:09.614452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a1f8-b1ac-4f59-9cdc-745c9d5dccbe service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.614452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a1f8-b1ac-4f59-9cdc-745c9d5dccbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.614452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662a1f8-b1ac-4f59-9cdc-745c9d5dccbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.624240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662a1f8-b1ac-4f59-9cdc-745c9d5dccbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:09.626588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662a1f8-b1ac-4f59-9cdc-745c9d5dccbe service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:09.641533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1374/2724] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:14.462857 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:14.530687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49569e0a-5036-4ef5-859a-03395239c62f service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:14.535266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:14.535894 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.536183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.536458 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] PATH_INFO: `/v3/users/8553d4b9a3f2457bba277d34418967b7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.537579 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8553d4b9a3f2457bba277d34418967b7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:14.539592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:14.696823 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:14.706602 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8553d4b9a3f2457bba277d34418967b7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.707264 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8553d4b9a3f2457bba277d34418967b7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.707889 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8553d4b9a3f2457bba277d34418967b7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.715024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8553d4b9a3f2457bba277d34418967b7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.728899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8553d4b9a3f2457bba277d34418967b7'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.816999 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1351/2725] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:14 2022] DELETE /identity/v3/users/8553d4b9a3f2457bba277d34418967b7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:14.821976 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.822517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.822517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.844477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:14.846024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:14.910392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1375/2726] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:14.922825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:14.924784 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:14.988208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad49e-8fb4-4f86-a9e9-c0c14515965e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:14.991862 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:14.997322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.997322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.997322 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.003992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:15.005450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:15.017041 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1352/2727] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:15.511867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:15.513319 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.525510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96791d-a43e-4064-bc80-0bb75b600c40 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:15.530269 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:15.530811 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.531097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.531401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] PATH_INFO: `/v3/projects/e5749429957946ab835258c4fc5bdbe1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.532580 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5749429957946ab835258c4fc5bdbe1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:15.534497 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:15.686357 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5749429957946ab835258c4fc5bdbe1', 'request_id': 'req-b3524e85-f58d-4e91-be59-56008d1ee87f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:15.692708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5749429957946ab835258c4fc5bdbe1', 'request_id': 'req-b3524e85-f58d-4e91-be59-56008d1ee87f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:15.696447 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:15.742962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5749429957946ab835258c4fc5bdbe1', 'request_id': 'req-b3524e85-f58d-4e91-be59-56008d1ee87f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:15.757030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] The token cache is being invalidate because project e5749429957946ab835258c4fc5bdbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:15.757326 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:15.758030 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:15.759585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1376/2728] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:15 2022] DELETE /identity/v3/projects/e5749429957946ab835258c4fc5bdbe1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:15.764531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:15.774701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ec09-83e7-4f17-9756-c684ae8158dc service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:15.842399 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:15.843039 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.843328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.843606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] PATH_INFO: `/v3/users/8753d3a946214811b5bcb0c4e324ca9e` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.845447 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8753d3a946214811b5bcb0c4e324ca9e)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:15.847414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:16.058548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8753d3a946214811b5bcb0c4e324ca9e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:16.059278 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8753d3a946214811b5bcb0c4e324ca9e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:16.060098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8753d3a946214811b5bcb0c4e324ca9e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:16.069174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8753d3a946214811b5bcb0c4e324ca9e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:16.070359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:16.082565 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8753d3a946214811b5bcb0c4e324ca9e'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:16.188749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1353/2729] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:15 2022] DELETE /identity/v3/users/8753d3a946214811b5bcb0c4e324ca9e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:16.665493 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:16.667109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:16.681193 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3524e85-f58d-4e91-be59-56008d1ee87f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:16.746586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:16.747251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:16.747531 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:16.747867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] PATH_INFO: `/v3/projects/c91bff5570944d3c8d049ed53d118367` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:16.749073 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91bff5570944d3c8d049ed53d118367)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:16.751810 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:16.908900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91bff5570944d3c8d049ed53d118367', 'request_id': 'req-37642a4d-8dc7-4b09-8fbf-57147da99b92'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:16.914338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91bff5570944d3c8d049ed53d118367', 'request_id': 'req-37642a4d-8dc7-4b09-8fbf-57147da99b92'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.017393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91bff5570944d3c8d049ed53d118367', 'request_id': 'req-37642a4d-8dc7-4b09-8fbf-57147da99b92'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.030085 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] The token cache is being invalidate because project c91bff5570944d3c8d049ed53d118367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:17.030378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.031064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.032734 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1377/2730] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:16 2022] DELETE /identity/v3/projects/c91bff5570944d3c8d049ed53d118367 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:17.036729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:17.038218 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:17.053164 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4ce4-018e-4e9c-858c-9cc836a03125 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:17.113613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:17.114309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:17.114598 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:17.114879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] PATH_INFO: `/v3/users/0bece735e79a461f84acf4f5fe0c254b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:17.116010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bece735e79a461f84acf4f5fe0c254b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:17.117971 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:17.310136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bece735e79a461f84acf4f5fe0c254b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.310782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bece735e79a461f84acf4f5fe0c254b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.311396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bece735e79a461f84acf4f5fe0c254b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.319414 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bece735e79a461f84acf4f5fe0c254b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.333722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-94dd373c-7913-4fb6-a02c-e5ba176e1382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bece735e79a461f84acf4f5fe0c254b'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.434711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1354/2731] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:17 2022] DELETE /identity/v3/users/0bece735e79a461f84acf4f5fe0c254b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:17.967985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:17.970336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:17.985453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37642a4d-8dc7-4b09-8fbf-57147da99b92 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.054616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.055263 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.055541 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.055814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] PATH_INFO: `/v3/projects/87c594ad60f146f7b2a0fd2f84d108a3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.056956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c594ad60f146f7b2a0fd2f84d108a3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.058892 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.090049 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:18.213449 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c594ad60f146f7b2a0fd2f84d108a3', 'request_id': 'req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.220283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c594ad60f146f7b2a0fd2f84d108a3', 'request_id': 'req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.308921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c594ad60f146f7b2a0fd2f84d108a3', 'request_id': 'req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.321344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] The token cache is being invalidate because project 87c594ad60f146f7b2a0fd2f84d108a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:18.321632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.322291 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-b19a374e-6d30-47eb-9a6b-b04adbd3ca95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.323824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1378/2732] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:17 2022] DELETE /identity/v3/projects/87c594ad60f146f7b2a0fd2f84d108a3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:18.330016 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.330844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.330844 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.351352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:18.352499 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:18.403934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:18.417079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1355/2733] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:18.426115 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.426770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.426770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.446970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:18.449505 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:18.457393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1379/2734] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:18.461563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.472933 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1dceb-3418-4a29-9e19-4e8ef73fdfd9 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.477199 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.478192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.478192 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.478462 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.478976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:18.479275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.481114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.494187 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1356/2735] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:18.498228 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.507887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d0ea0-f199-4c3e-af4c-59f2d12869c7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.512908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.513517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.513796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.514112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.514747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.517582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.622569 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1380/2736] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:18.627155 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.634535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb111fe-8511-43ce-a83c-829d81a8e996 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.698718 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.699325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.699604 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.699874 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.700494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.702492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.790486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1357/2737] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:18.794730 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.805180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2234cdc-e5aa-468a-9a1b-2752ed3ee1c5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.809728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.810360 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.810642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.810916 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.811564 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.813692 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.823994 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1381/2738] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:18.829189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.841811 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b90f04-1efb-4b1c-8533-6d12f982fd5e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.846425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc49fa-f91c-445e-8cc3-eead6ed96d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.847028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc49fa-f91c-445e-8cc3-eead6ed96d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.847339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc49fa-f91c-445e-8cc3-eead6ed96d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.847614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc49fa-f91c-445e-8cc3-eead6ed96d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.848248 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc49fa-f91c-445e-8cc3-eead6ed96d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.849842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc49fa-f91c-445e-8cc3-eead6ed96d76 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.860681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1358/2739] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:18.864929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.874866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2cfeb-bd14-4c2a-80e7-b0f50900a626 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.880122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.880835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.881147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.881427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] PATH_INFO: `/v3/projects/67f2188f35834fa682e40a5a16b3432f/users/5716f34de85740068c6262ae2e670508/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.898982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f2188f35834fa682e40a5a16b3432f, user_id=5716f34de85740068c6262ae2e670508, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.901620 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.002177 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1382/2740] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:18 2022] PUT /identity/v3/projects/67f2188f35834fa682e40a5a16b3432f/users/5716f34de85740068c6262ae2e670508/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:19.072736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f038-f916-475c-b5e1-b897034a9772 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.073024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f038-f916-475c-b5e1-b897034a9772 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.073298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f038-f916-475c-b5e1-b897034a9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:19.103913 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-87c1f038-f916-475c-b5e1-b897034a9772 None None] MFA Rules not processed for user `5716f34de85740068c6262ae2e670508`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:19.105461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87c1f038-f916-475c-b5e1-b897034a9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:19.181931 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1359/2741] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:19.193400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:19.195130 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:19.255938 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659bb13-637d-47e9-b48c-49cee70ae248 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:19.259546 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:19.260155 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.260432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.260710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:19.270466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:19.271893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.280621 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1383/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:29.178563 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:29.276791 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:29.374448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.374871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.375249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.394794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:29.396032 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.460346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1360/2743] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:29.498677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:29.498677 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.575171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572ef4-0894-4d1e-942b-d19bf1b34333 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:29.580832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2096e-894e-47e8-afa2-79f9ac48065c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:29.581427 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2096e-894e-47e8-afa2-79f9ac48065c service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.581711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2096e-894e-47e8-afa2-79f9ac48065c service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.582025 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2096e-894e-47e8-afa2-79f9ac48065c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.591437 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2096e-894e-47e8-afa2-79f9ac48065c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:29.596740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2096e-894e-47e8-afa2-79f9ac48065c service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:29.603911 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1384/2744] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:30.980357 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:30.992146 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed0ea-78fa-441f-8b62-cf02ee4745f0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:30.996879 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:30.997531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:30.997909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:30.998184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] PATH_INFO: `/v3/users/5716f34de85740068c6262ae2e670508` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:30.999312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5716f34de85740068c6262ae2e670508)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.001312 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:31.195709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5716f34de85740068c6262ae2e670508'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.196370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5716f34de85740068c6262ae2e670508'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.197019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5716f34de85740068c6262ae2e670508'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.204304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5716f34de85740068c6262ae2e670508'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.218584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5716f34de85740068c6262ae2e670508'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.297180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1361/2745] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:30 2022] DELETE /identity/v3/users/5716f34de85740068c6262ae2e670508 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:31.301921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.302454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.302611 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.322151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:31.323396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.388140 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1385/2746] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:31.399289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.400993 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.464584 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df9dcd-435d-4666-b3b3-4ee520dcc38c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.470347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef89647-5f3c-432a-aaf8-1e9f1abaebf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.470977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef89647-5f3c-432a-aaf8-1e9f1abaebf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.471255 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef89647-5f3c-432a-aaf8-1e9f1abaebf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.471527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef89647-5f3c-432a-aaf8-1e9f1abaebf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.482717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef89647-5f3c-432a-aaf8-1e9f1abaebf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.484162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef89647-5f3c-432a-aaf8-1e9f1abaebf9 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:31.495665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1362/2747] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:31.903478 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.906054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.923334 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea18127-0513-417c-aaaa-b84d9aaf53ea None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.928753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.929454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.929724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.930037 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] PATH_INFO: `/v3/projects/67f2188f35834fa682e40a5a16b3432f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.931372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f2188f35834fa682e40a5a16b3432f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.933293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.099251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f2188f35834fa682e40a5a16b3432f', 'request_id': 'req-57351884-4de7-4488-81ec-4e60fafdbf60'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.105508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f2188f35834fa682e40a5a16b3432f', 'request_id': 'req-57351884-4de7-4488-81ec-4e60fafdbf60'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.224879 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f2188f35834fa682e40a5a16b3432f', 'request_id': 'req-57351884-4de7-4488-81ec-4e60fafdbf60'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.236776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] The token cache is being invalidate because project 67f2188f35834fa682e40a5a16b3432f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:32.237072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.237738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.239779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1386/2748] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:31 2022] DELETE /identity/v3/projects/67f2188f35834fa682e40a5a16b3432f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:33.651615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52f6f3-693d-4570-8b58-2a2c7e87ceb8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.652495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52f6f3-693d-4570-8b58-2a2c7e87ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.652675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52f6f3-693d-4570-8b58-2a2c7e87ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.673230 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3b52f6f3-693d-4570-8b58-2a2c7e87ceb8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.674460 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3b52f6f3-693d-4570-8b58-2a2c7e87ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.683806 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:33.734512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1363/2749] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.756838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.758299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.769986 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:33.833838 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351884-4de7-4488-81ec-4e60fafdbf60 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.839753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.840369 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.843891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.843891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.849979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.851831 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.861614 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1387/2750] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:38.095136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec73e-89ba-420b-8404-561631e7642f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.095714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec73e-89ba-420b-8404-561631e7642f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.095714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec73e-89ba-420b-8404-561631e7642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.116368 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7aaec73e-89ba-420b-8404-561631e7642f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:38.117608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7aaec73e-89ba-420b-8404-561631e7642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:38.125489 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1364/2751] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:38.146787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:38.148165 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:38.163282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672c4b-b819-4195-8a8d-822fb13676a0 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:38.170127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.170725 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.171008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.171285 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.179574 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.181144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.190606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1388/2752] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:40.984813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9529bf-2e57-4766-9503-e3cd8f89c38b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.985443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9529bf-2e57-4766-9503-e3cd8f89c38b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.985443 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9529bf-2e57-4766-9503-e3cd8f89c38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.007062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1b9529bf-2e57-4766-9503-e3cd8f89c38b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:41.008269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1b9529bf-2e57-4766-9503-e3cd8f89c38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.022824 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1365/2753] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:41.044852 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.056667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb0304-3722-4fa0-b8c5-5b617506512c service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.062303 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.062896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.067096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.067096 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.072148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.073728 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.084029 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1389/2754] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:44.265100 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d325-01e3-4260-8d2e-15f8d0ad6714 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:44.265692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d325-01e3-4260-8d2e-15f8d0ad6714 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:44.265692 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931d325-01e3-4260-8d2e-15f8d0ad6714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:44.285606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9931d325-01e3-4260-8d2e-15f8d0ad6714 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:44.286755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9931d325-01e3-4260-8d2e-15f8d0ad6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:44.295630 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1366/2755] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:44.320886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:44.332389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d50030-c819-427a-b21e-44101057f96c service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:44.339106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:44.339707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:44.340023 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:44.340345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:44.349078 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:44.350691 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:44.361517 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1390/2756] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:47.489289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cd9ff-f2ad-4265-acf8-5c2f96a805cd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.489926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cd9ff-f2ad-4265-acf8-5c2f96a805cd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.489926 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cd9ff-f2ad-4265-acf8-5c2f96a805cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.512476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8f4cd9ff-f2ad-4265-acf8-5c2f96a805cd None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:47.513695 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f4cd9ff-f2ad-4265-acf8-5c2f96a805cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.521683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1367/2757] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:47.544528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.574655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559f25-5a0f-448b-98a7-1b5f6ac36b71 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.582883 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7b3e9-6b24-4140-b3b9-354a89f6dea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.583512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b3e9-6b24-4140-b3b9-354a89f6dea6 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.583796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b3e9-6b24-4140-b3b9-354a89f6dea6 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.584075 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b3e9-6b24-4140-b3b9-354a89f6dea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.593943 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b3e9-6b24-4140-b3b9-354a89f6dea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.595827 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b3e9-6b24-4140-b3b9-354a89f6dea6 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.606560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1391/2758] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:57.507520 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=32 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:57.601120 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=61 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:05.420463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:05.421019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:05.421019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:05.440910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] MFA Rules not processed for user `b041a3806ef04fc080c15b838e81b6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:05.442089 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:05.498792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1368/2759] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:06.234809 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7832-6ff3-46bd-b772-d26f7a5ab539 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:06.235652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7832-6ff3-46bd-b772-d26f7a5ab539 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:06.235652 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac7832-6ff3-46bd-b772-d26f7a5ab539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:06.256581 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-12ac7832-6ff3-46bd-b772-d26f7a5ab539 None None] MFA Rules not processed for user `3eab3fa7fa104a9d9cdcdbae7502d9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:06.258043 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-12ac7832-6ff3-46bd-b772-d26f7a5ab539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:06.327362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1392/2760] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:08.158405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.159803 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:08.253714 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea875c-19ed-4506-87d9-ce935fca14a0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.259541 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.260156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.260441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.260716 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.262551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:08.275311 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:08.276960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:08.287111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1369/2761] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:16.316584 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=25 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.282826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=66 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:25.577441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bd3f3-3a9b-4722-9f51-9e92a681d600 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.578015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bd3f3-3a9b-4722-9f51-9e92a681d600 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.578112 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bd3f3-3a9b-4722-9f51-9e92a681d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.597756 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-783bd3f3-3a9b-4722-9f51-9e92a681d600 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:25.598968 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-783bd3f3-3a9b-4722-9f51-9e92a681d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:25.608931 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1393/2762] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:25.628953 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:25.642116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d325803-9747-4701-8223-8cbc7261a795 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:25.647703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:25.648339 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:25.648623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:25.649609 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.662949 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:25.664670 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:25.676174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1370/2763] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:29.109568 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbcc3b-b07e-48f2-9e39-15540f766594 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.110159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbcc3b-b07e-48f2-9e39-15540f766594 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.110159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbcc3b-b07e-48f2-9e39-15540f766594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.130972 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-60fbcc3b-b07e-48f2-9e39-15540f766594 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:29.132173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-60fbcc3b-b07e-48f2-9e39-15540f766594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:29.141060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1394/2764] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:29.181042 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:29.192666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc7b02-9546-4b15-881b-f3492a89effa service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:29.198217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:29.199349 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.199632 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.199906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.208423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:29.210099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:29.220071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1371/2765] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:31.995895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5c95-6a10-494f-9723-77b4202d6393 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.996528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5c95-6a10-494f-9723-77b4202d6393 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.996528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa5c95-6a10-494f-9723-77b4202d6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.017553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c7fa5c95-6a10-494f-9723-77b4202d6393 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:32.018964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c7fa5c95-6a10-494f-9723-77b4202d6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:32.028004 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1395/2766] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:32.051525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:32.063756 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60fa9-5a11-4618-9873-9ca28c619037 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:32.069367 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:32.070037 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.070320 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.070592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.080343 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:32.081976 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:32.094423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1372/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:35.210724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177dec-5dfb-47e7-83d7-e63e0838e163 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:35.211264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177dec-5dfb-47e7-83d7-e63e0838e163 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:35.211264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d177dec-5dfb-47e7-83d7-e63e0838e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:35.231084 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7d177dec-5dfb-47e7-83d7-e63e0838e163 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:35.232277 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7d177dec-5dfb-47e7-83d7-e63e0838e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:35.240770 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1396/2768] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:35.264876 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:35.276293 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955969e-189f-48b9-80cc-64e09109f931 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:35.282104 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:35.283370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:35.283649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:35.283916 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:35.292063 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:35.293624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:35.303871 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1373/2769] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:38.449001 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.449553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.449553 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.468914 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:38.470147 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:38.479337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1397/2770] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 09:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:38.508691 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:38.519856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bb5d-76da-4600-b424-7eb0429801bd service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:38.525189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:38.525841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:38.526147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:38.526417 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:38.534423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:38.536236 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:38.545496 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1374/2771] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:48.464338 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=15 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:48.541354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=30 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:10.911072 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:10.913616 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:10.928610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f8738-c2b7-45ef-9149-62ead894afa9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:10.933724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:10.934480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:10.934846 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:10.935189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] PATH_INFO: `/v3/users/3eab3fa7fa104a9d9cdcdbae7502d9d6` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:10.936414 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eab3fa7fa104a9d9cdcdbae7502d9d6)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:10.938995 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.140453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eab3fa7fa104a9d9cdcdbae7502d9d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.206929 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eab3fa7fa104a9d9cdcdbae7502d9d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.207548 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eab3fa7fa104a9d9cdcdbae7502d9d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.221119 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eab3fa7fa104a9d9cdcdbae7502d9d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.221801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eab3fa7fa104a9d9cdcdbae7502d9d6'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.234470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1398/2772] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:10 2022] DELETE /identity/v3/users/3eab3fa7fa104a9d9cdcdbae7502d9d6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:11.475881 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:11.488364 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae2cb3-9bbc-4121-8cb7-653871116b5b service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:11.553394 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:11.554058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:11.554341 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:11.554615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] PATH_INFO: `/v3/projects/46adbfe9261e4fb0aa9fed3dba6c33ff` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:11.555746 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46adbfe9261e4fb0aa9fed3dba6c33ff)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:11.557631 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:11.703326 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46adbfe9261e4fb0aa9fed3dba6c33ff', 'request_id': 'req-208d7071-73e4-4144-a7ca-c19b289a3a51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.709346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46adbfe9261e4fb0aa9fed3dba6c33ff', 'request_id': 'req-208d7071-73e4-4144-a7ca-c19b289a3a51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.793792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46adbfe9261e4fb0aa9fed3dba6c33ff', 'request_id': 'req-208d7071-73e4-4144-a7ca-c19b289a3a51'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.807365 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] The token cache is being invalidate because project 46adbfe9261e4fb0aa9fed3dba6c33ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:11.809592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.809592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:11.809837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1375/2773] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:11 2022] DELETE /identity/v3/projects/46adbfe9261e4fb0aa9fed3dba6c33ff => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:47:20.646764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:20.648362 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:20.663264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd8df-de0f-46d6-9550-73667e041187 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:20.721440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:20.722109 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:20.722394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:20.722669 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] PATH_INFO: `/v3/users/b041a3806ef04fc080c15b838e81b6ca` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:20.723817 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b041a3806ef04fc080c15b838e81b6ca)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:20.726013 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:20.922870 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b041a3806ef04fc080c15b838e81b6ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.005599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b041a3806ef04fc080c15b838e81b6ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.006604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b041a3806ef04fc080c15b838e81b6ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.023040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b041a3806ef04fc080c15b838e81b6ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.023742 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e0a03abf-19fe-4174-905a-fc44f8e72eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b041a3806ef04fc080c15b838e81b6ca'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.026451 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.037168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1399/2774] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:20 2022] DELETE /identity/v3/users/b041a3806ef04fc080c15b838e81b6ca => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:21.294169 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.295685 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:21.311663 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d7071-73e4-4144-a7ca-c19b289a3a51 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.379156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.379744 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.380083 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.380378 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] PATH_INFO: `/v3/projects/e058ec23c62e460ba470383b046d1c6c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.381626 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e058ec23c62e460ba470383b046d1c6c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.383673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.519256 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:21.534141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e058ec23c62e460ba470383b046d1c6c', 'request_id': 'req-e41f491c-b7a6-49bb-a3e0-555f749c1458'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.545374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e058ec23c62e460ba470383b046d1c6c', 'request_id': 'req-e41f491c-b7a6-49bb-a3e0-555f749c1458'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.621790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e058ec23c62e460ba470383b046d1c6c', 'request_id': 'req-e41f491c-b7a6-49bb-a3e0-555f749c1458'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.634359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] The token cache is being invalidate because project e058ec23c62e460ba470383b046d1c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:21.634922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.635710 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e41f491c-b7a6-49bb-a3e0-555f749c1458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:21.637249 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1376/2775] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:21 2022] DELETE /identity/v3/projects/e058ec23c62e460ba470383b046d1c6c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:21.642335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.642619 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.642888 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.662560 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:21.663765 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:21.736374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1400/2776] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:21.745465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.745918 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.746337 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.767475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:21.768668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:21.780266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1377/2777] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:21.783099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.792844 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ec4a-b070-4d86-b5c0-94f4b8cfb3f5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.797759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.798403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.798678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.798950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.799594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:21.799895 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.801557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.814683 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1401/2778] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:21.819740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.833580 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6304-d2a8-4544-b004-e361bd201822 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.839688 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.840288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.840567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.840838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.841464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.843398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:21.921381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1378/2779] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:21 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:21.925173 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:21.935632 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8b72-d281-4c9a-bfe9-027fd141bbff admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:21.995404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:21.996048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:21.996333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:21.996600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:21.997218 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:21.999137 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.136930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1402/2780] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:21 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:22.141157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.151271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ca3e4-c475-4303-8ca7-4332eba25f65 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.155849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.156454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.156732 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.157007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.157649 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.159285 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.171267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1379/2781] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:22.175415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.186257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81577348-e878-4ca5-ad85-cc7661ff9510 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.190775 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921bf24-585b-4a46-8e9b-5d7c1279b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.191363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921bf24-585b-4a46-8e9b-5d7c1279b6da admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.191642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921bf24-585b-4a46-8e9b-5d7c1279b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.191967 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921bf24-585b-4a46-8e9b-5d7c1279b6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.192634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921bf24-585b-4a46-8e9b-5d7c1279b6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.194254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921bf24-585b-4a46-8e9b-5d7c1279b6da admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.204787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1403/2782] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:22.209017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.219283 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13369f-2a16-4e08-a417-7c13a69fe5c1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.224019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.224934 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.225215 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.225481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] PATH_INFO: `/v3/projects/54c15f11dc5e41df8a7c2d8278f81f12/users/3567f8e750da4d80af84b9d3c81038f0/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.241198 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c15f11dc5e41df8a7c2d8278f81f12, user_id=3567f8e750da4d80af84b9d3c81038f0, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.243863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.321082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1380/2783] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:22 2022] PUT /identity/v3/projects/54c15f11dc5e41df8a7c2d8278f81f12/users/3567f8e750da4d80af84b9d3c81038f0/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:22.331642 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.331926 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.334039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.360898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] MFA Rules not processed for user `3567f8e750da4d80af84b9d3c81038f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:22.362753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:22.407747 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:22.427487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1404/2784] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:22.432763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.499220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030a88-b2b4-4d32-b2ca-14d272250267 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.503779 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.504386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.505001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.505001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.505550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.507611 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.635055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1381/2785] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:22 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:22.639168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.649748 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fd95e-bb37-4f80-86ed-c2e4abf83277 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.707643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.708329 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.708537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.708805 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.709464 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.711420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.816425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1405/2786] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:22 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:22.821828 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.834628 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091160e-765a-494f-82c7-d895066404ab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.840987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.841599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.841899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.842174 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.842845 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.844433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:22.856509 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1382/2787] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:22.860939 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:22.871381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af7b9a-52e0-4b80-b639-6c89858ac2fb admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:22.876188 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:22.876835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:22.877116 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:22.877392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] PATH_INFO: `/v3/projects/bd1461817e1d422b9b37f8d3433ad62f/users/7287a2512b80401cad8635e717fb559d/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:22.893492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1461817e1d422b9b37f8d3433ad62f, user_id=7287a2512b80401cad8635e717fb559d, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:22.896381 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.005035 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1406/2788] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:22 2022] PUT /identity/v3/projects/bd1461817e1d422b9b37f8d3433ad62f/users/7287a2512b80401cad8635e717fb559d/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:23.009136 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.019542 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce3a82-1b69-4f1e-89e4-47ba4860ee23 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.054884 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:23.082856 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733de34-72be-4520-8c91-fc45d4a65818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.083476 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733de34-72be-4520-8c91-fc45d4a65818 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.083754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733de34-72be-4520-8c91-fc45d4a65818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.084028 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733de34-72be-4520-8c91-fc45d4a65818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.084673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733de34-72be-4520-8c91-fc45d4a65818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.086324 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733de34-72be-4520-8c91-fc45d4a65818 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.096501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1383/2789] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:23.101111 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.112192 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56325f9-53de-473e-a05a-b069dccf7096 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.116745 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.117617 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.117947 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.118208 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] PATH_INFO: `/v3/projects/bd1461817e1d422b9b37f8d3433ad62f/users/7287a2512b80401cad8635e717fb559d/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.122875 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1461817e1d422b9b37f8d3433ad62f, user_id=7287a2512b80401cad8635e717fb559d, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.123506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.133749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1407/2790] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:23 2022] PUT /identity/v3/projects/bd1461817e1d422b9b37f8d3433ad62f/users/7287a2512b80401cad8635e717fb559d/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:23.145352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.145637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.146020 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.174087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] MFA Rules not processed for user `7287a2512b80401cad8635e717fb559d`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:23.175507 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:23.247987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1384/2791] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:23.261389 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:23.263251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:23.321534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5976-82c0-4f21-a547-51551816f06a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:23.325813 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:23.326439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:23.326717 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:23.326985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:23.336322 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:23.337761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:23.347754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1408/2792] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:24.394472 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.403754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8106e4b-346f-44db-bbc3-e6204a593ac7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.408482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7287a2512b80401cad8635e717fb559d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1461817e1d422b9b37f8d3433ad62f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.409003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.409292 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.409574 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.410268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:24.410578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.412179 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.424495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1385/2793] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:24.428854 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.438971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd808e0-8264-4ce9-a410-3becc6aadf49 service cinder] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.443590 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7287a2512b80401cad8635e717fb559d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1461817e1d422b9b37f8d3433ad62f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.444189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.444476 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.444754 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.445385 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.447314 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.544510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1409/2794] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:24 2022] POST /identity/v3/projects => generated 355 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:24.549415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.560597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcf14a-3d76-4e9a-9d26-68d198832c7f tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.617217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7287a2512b80401cad8635e717fb559d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1461817e1d422b9b37f8d3433ad62f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.617742 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.618055 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.618334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.618977 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:24.619287 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.621544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.634150 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1386/2795] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:24.671900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:24.682265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa2ff-aa72-4668-bb2b-247728143d61 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:24.687848 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7287a2512b80401cad8635e717fb559d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd1461817e1d422b9b37f8d3433ad62f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:24.688482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:24.688773 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:24.689152 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] PATH_INFO: `/v3/projects/c31795fd5c0e406daf1c31d7c9d8ecce` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:24.690234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c31795fd5c0e406daf1c31d7c9d8ecce)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:24.692144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:24.708973 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:24.811297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31795fd5c0e406daf1c31d7c9d8ecce', 'request_id': 'req-a5b95210-075c-4a6d-9997-1e604a7cb145'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:24.819694 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31795fd5c0e406daf1c31d7c9d8ecce', 'request_id': 'req-a5b95210-075c-4a6d-9997-1e604a7cb145'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:24.901803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31795fd5c0e406daf1c31d7c9d8ecce', 'request_id': 'req-a5b95210-075c-4a6d-9997-1e604a7cb145'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:24.914795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] The token cache is being invalidate because project c31795fd5c0e406daf1c31d7c9d8ecce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:24.915135 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:24.915785 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-a5b95210-075c-4a6d-9997-1e604a7cb145 tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:24.917290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1410/2796] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:24 2022] DELETE /identity/v3/projects/c31795fd5c0e406daf1c31d7c9d8ecce => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:25.582762 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:25.584907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:25.621751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:25.652968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11a7e3-d403-42da-bda6-b3e975e0debd tempest-VolumeQuotaClassesTest-2043388101 tempest-VolumeQuotaClassesTest-2043388101-project-admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:25.709457 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:25.710114 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.710395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.710666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] PATH_INFO: `/v3/users/3567f8e750da4d80af84b9d3c81038f0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:25.711790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3567f8e750da4d80af84b9d3c81038f0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:25.713687 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:25.900258 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3567f8e750da4d80af84b9d3c81038f0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:25.900925 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3567f8e750da4d80af84b9d3c81038f0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:25.901539 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3567f8e750da4d80af84b9d3c81038f0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:25.908599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3567f8e750da4d80af84b9d3c81038f0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:25.921099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3567f8e750da4d80af84b9d3c81038f0'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:25.972095 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1387/2797] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:25 2022] DELETE /identity/v3/users/3567f8e750da4d80af84b9d3c81038f0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:25.977935 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:25.978586 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:25.979017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.004339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:26.005592 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:26.066156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1411/2798] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:26.081578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.081578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:26.139070 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f183-4022-4968-b6f6-1619ddf987c9 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.144627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.145267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.145554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.146162 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.157080 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.158644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.168295 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1388/2799] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:26.625595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.625595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:26.638429 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e2e75-c6d2-4a1e-8732-3d159ee85664 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.643753 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.644415 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.644696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.644971 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] PATH_INFO: `/v3/projects/54c15f11dc5e41df8a7c2d8278f81f12` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.646225 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c15f11dc5e41df8a7c2d8278f81f12)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.648154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:26.744347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c15f11dc5e41df8a7c2d8278f81f12', 'request_id': 'req-f391d8e2-fd66-407a-b3a0-adbc05256850'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:26.750405 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c15f11dc5e41df8a7c2d8278f81f12', 'request_id': 'req-f391d8e2-fd66-407a-b3a0-adbc05256850'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:26.811882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c15f11dc5e41df8a7c2d8278f81f12', 'request_id': 'req-f391d8e2-fd66-407a-b3a0-adbc05256850'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:26.825265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] The token cache is being invalidate because project 54c15f11dc5e41df8a7c2d8278f81f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:26.825265 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:26.825454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:26.827002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1412/2800] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:26 2022] DELETE /identity/v3/projects/54c15f11dc5e41df8a7c2d8278f81f12 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:26.831087 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:26.835917 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:26.842143 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44124c-df74-4da7-a2e4-904ad9b6aea5 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:26.901519 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:26.902094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:26.903332 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:26.903606 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] PATH_INFO: `/v3/users/7287a2512b80401cad8635e717fb559d` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:26.904758 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7287a2512b80401cad8635e717fb559d)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:26.907683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:27.132702 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7287a2512b80401cad8635e717fb559d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.133392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7287a2512b80401cad8635e717fb559d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.134071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7287a2512b80401cad8635e717fb559d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.141319 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7287a2512b80401cad8635e717fb559d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.153755 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f2dfe032-37b7-4e2f-99a8-22b402747af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7287a2512b80401cad8635e717fb559d'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.235544 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1389/2801] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:26 2022] DELETE /identity/v3/users/7287a2512b80401cad8635e717fb559d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:27.637126 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:27.638594 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:27.652527 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391d8e2-fd66-407a-b3a0-adbc05256850 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:27.678260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:27.710231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:27.710863 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.711144 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.711418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] PATH_INFO: `/v3/projects/bd1461817e1d422b9b37f8d3433ad62f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.712534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1461817e1d422b9b37f8d3433ad62f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:27.715099 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:27.813663 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1461817e1d422b9b37f8d3433ad62f', 'request_id': 'req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.819282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1461817e1d422b9b37f8d3433ad62f', 'request_id': 'req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.878793 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1461817e1d422b9b37f8d3433ad62f', 'request_id': 'req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.891882 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] The token cache is being invalidate because project bd1461817e1d422b9b37f8d3433ad62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:27.892175 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.892816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-2a2a43cc-c4db-4102-9a7f-6a31ff6d8ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:27.894441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1413/2802] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:27 2022] DELETE /identity/v3/projects/bd1461817e1d422b9b37f8d3433ad62f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:27.899333 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f255-167f-4b86-a679-8da79c076510 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.899928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f255-167f-4b86-a679-8da79c076510 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.899928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f255-167f-4b86-a679-8da79c076510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:27.919722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a046f255-167f-4b86-a679-8da79c076510 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:27.920851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a046f255-167f-4b86-a679-8da79c076510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:27.981001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1390/2803] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:27.988871 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:27.989159 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:27.989439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.009468 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:28.010712 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:28.019244 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1414/2804] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:28.023600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046f255-167f-4b86-a679-8da79c076510 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.033432 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046f255-167f-4b86-a679-8da79c076510 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.038101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.038708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.038996 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.039275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.039928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:28.042731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.042731 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.054122 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1391/2805] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:28.058988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.068246 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf47c7-9529-4ad0-917d-fe29a73cc900 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.072908 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.073509 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.074477 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.074779 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.077156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.077332 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.151282 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1415/2806] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:28 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:28.155791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.166004 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9cf31-6ce8-4ebf-b5e0-68e0e3ddc594 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.171592 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.223334 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.224190 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.224475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.224751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.225390 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.227374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.315597 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1392/2807] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:28 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:28.319925 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.330201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87c30-6c64-4808-ac95-d5e990b02058 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.335866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.336475 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.336758 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.337028 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.337667 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.339299 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.349566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1416/2808] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:28.353614 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.364205 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6803a27-65e2-4529-9797-5c9360799dd1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.368677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962b239-f176-41f7-81b5-6ab2e0b82cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.369271 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b239-f176-41f7-81b5-6ab2e0b82cad admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.369545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b239-f176-41f7-81b5-6ab2e0b82cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.369816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b239-f176-41f7-81b5-6ab2e0b82cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.370473 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962b239-f176-41f7-81b5-6ab2e0b82cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.372736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962b239-f176-41f7-81b5-6ab2e0b82cad admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.383422 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1393/2809] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:28.387814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.398156 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa16ede-809f-4880-9f7f-d339d210c491 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.402903 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.403549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.403830 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.404106 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] PATH_INFO: `/v3/projects/3431efcfbf5b4548a7212169d09b208f/users/112f03a4fbc14d9290559bab7829b62c/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.420647 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3431efcfbf5b4548a7212169d09b208f, user_id=112f03a4fbc14d9290559bab7829b62c, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.423512 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.486562 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1417/2810] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:28 2022] PUT /identity/v3/projects/3431efcfbf5b4548a7212169d09b208f/users/112f03a4fbc14d9290559bab7829b62c/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:28.496813 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.497219 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.497503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.525634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] MFA Rules not processed for user `112f03a4fbc14d9290559bab7829b62c`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:28.527474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:28.591594 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1394/2811] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:28.596610 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.647510 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.658061 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e58a03-884b-4f61-aa6f-db919ea33277 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.662762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.663367 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.663648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.663948 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.664570 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.666494 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.797441 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1418/2812] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:28 2022] POST /identity/v3/projects => generated 391 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:28.801413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.812554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c581e-7fa5-432f-9bb1-7801084c1fb0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.874467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.875970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.875970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.875970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.875970 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.877890 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.959289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1395/2813] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:28 2022] POST /identity/v3/users => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:28.963297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:28.974684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe952f-f3ea-4774-8047-12e5fab25be8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:28.979333 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:28.981910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:28.981910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:28.981910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:28.981910 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:28.982915 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:28.992982 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1419/2814] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:28.997269 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.007415 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83f4db-e551-4f39-abd2-ca93970081d2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.012776 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.013435 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.013720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.014043 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] PATH_INFO: `/v3/projects/d2c01f1be92242118fe13a790f7fdb50/users/82055ed67b194627b543db3bc6273dbb/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.017101 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.031403 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c01f1be92242118fe13a790f7fdb50, user_id=82055ed67b194627b543db3bc6273dbb, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.034288 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.114605 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1396/2815] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:28 2022] PUT /identity/v3/projects/d2c01f1be92242118fe13a790f7fdb50/users/82055ed67b194627b543db3bc6273dbb/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:29.118840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.129252 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283767e-5500-4c2a-8af8-acbc43d0e425 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.185328 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0816e27-aeaf-43d5-a205-d3361a2c9628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.185962 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816e27-aeaf-43d5-a205-d3361a2c9628 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.186248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816e27-aeaf-43d5-a205-d3361a2c9628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.186525 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0816e27-aeaf-43d5-a205-d3361a2c9628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.187164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816e27-aeaf-43d5-a205-d3361a2c9628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.188760 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0816e27-aeaf-43d5-a205-d3361a2c9628 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.198412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1420/2816] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:29.203952 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.214463 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7c2d-5aa7-42bc-bbbf-03c71cfdb3c3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.219781 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.220425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.220709 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.220980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] PATH_INFO: `/v3/projects/d2c01f1be92242118fe13a790f7fdb50/users/82055ed67b194627b543db3bc6273dbb/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.223115 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c01f1be92242118fe13a790f7fdb50, user_id=82055ed67b194627b543db3bc6273dbb, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.226167 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.237140 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1397/2817] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:29 2022] PUT /identity/v3/projects/d2c01f1be92242118fe13a790f7fdb50/users/82055ed67b194627b543db3bc6273dbb/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:29.249643 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.249975 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.250258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.280555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] MFA Rules not processed for user `82055ed67b194627b543db3bc6273dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:29.281776 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:29.351122 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1421/2818] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:29.364974 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.366815 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:29.426482 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09739ce-09c3-4c75-aee5-0efed8c8e168 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.430617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.431220 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.431500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.431774 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.441424 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.442880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.452851 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1398/2819] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:29.501522 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:29.501655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:29.514711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018bdaa-ad2e-4f2c-9e45-4d571fa6b872 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:29.518347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f962f-8415-4e40-ae55-10634fcf23b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:29.518959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f962f-8415-4e40-ae55-10634fcf23b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:29.519251 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f962f-8415-4e40-ae55-10634fcf23b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:29.519528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f962f-8415-4e40-ae55-10634fcf23b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:29.564264 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.577000 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f962f-8415-4e40-ae55-10634fcf23b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:29.578561 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f962f-8415-4e40-ae55-10634fcf23b6 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:29.587387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1422/2820] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:34.280798 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.343557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e81c8-733c-4d47-8f61-eb48df719890 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.348578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.349494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.349833 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.350156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] PATH_INFO: `/v3/users/112f03a4fbc14d9290559bab7829b62c` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.351289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112f03a4fbc14d9290559bab7829b62c)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.353451 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.518535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112f03a4fbc14d9290559bab7829b62c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:34.519224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112f03a4fbc14d9290559bab7829b62c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:34.519872 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112f03a4fbc14d9290559bab7829b62c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:34.527992 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112f03a4fbc14d9290559bab7829b62c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:34.540550 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112f03a4fbc14d9290559bab7829b62c'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:34.543202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:34.652082 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1399/2821] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:34 2022] DELETE /identity/v3/users/112f03a4fbc14d9290559bab7829b62c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:34.656930 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.657453 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.657566 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.677231 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:34.678496 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:34.738337 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1423/2822] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:34.748421 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:34.749832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:34.806922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c185b0-5b38-4aee-b699-265f3edcb101 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:34.810514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:34.811178 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:34.811461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:34.811733 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:34.820724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:34.822182 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:34.832627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1400/2823] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:35.251454 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.257198 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:35.267644 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7a1ca-65b9-4063-be1d-a7e72e17c377 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.273104 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.274347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.274629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.275097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] PATH_INFO: `/v3/projects/3431efcfbf5b4548a7212169d09b208f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.276396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3431efcfbf5b4548a7212169d09b208f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.278889 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.376545 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3431efcfbf5b4548a7212169d09b208f', 'request_id': 'req-ca0150df-b405-4e3d-90f8-0400657cd3e3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.382335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3431efcfbf5b4548a7212169d09b208f', 'request_id': 'req-ca0150df-b405-4e3d-90f8-0400657cd3e3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.460909 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3431efcfbf5b4548a7212169d09b208f', 'request_id': 'req-ca0150df-b405-4e3d-90f8-0400657cd3e3'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.472762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] The token cache is being invalidate because project 3431efcfbf5b4548a7212169d09b208f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:35.473054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.473974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.475466 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1424/2824] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:35 2022] DELETE /identity/v3/projects/3431efcfbf5b4548a7212169d09b208f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:35.479527 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:35.490213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b29d3-7522-4cf0-b6a5-ba781726d8e6 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:35.546800 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:35.547433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:35.547717 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:35.548021 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] PATH_INFO: `/v3/users/82055ed67b194627b543db3bc6273dbb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:35.549147 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82055ed67b194627b543db3bc6273dbb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:35.551096 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:35.745792 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82055ed67b194627b543db3bc6273dbb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.746675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82055ed67b194627b543db3bc6273dbb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.747298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82055ed67b194627b543db3bc6273dbb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.754309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82055ed67b194627b543db3bc6273dbb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.766439 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-21393fb5-adf6-4fcb-9e76-5e83d64dcfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82055ed67b194627b543db3bc6273dbb'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:35.852505 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1401/2825] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:35 2022] DELETE /identity/v3/users/82055ed67b194627b543db3bc6273dbb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:36.264608 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.266315 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:36.280696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0150df-b405-4e3d-90f8-0400657cd3e3 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.358373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.359022 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.359283 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.359555 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] PATH_INFO: `/v3/projects/d2c01f1be92242118fe13a790f7fdb50` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.360662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c01f1be92242118fe13a790f7fdb50)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.362656 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.373934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.486430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c01f1be92242118fe13a790f7fdb50', 'request_id': 'req-18c84cbc-8480-4740-be6e-d7d11a7e078b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:36.491979 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c01f1be92242118fe13a790f7fdb50', 'request_id': 'req-18c84cbc-8480-4740-be6e-d7d11a7e078b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:36.578020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c01f1be92242118fe13a790f7fdb50', 'request_id': 'req-18c84cbc-8480-4740-be6e-d7d11a7e078b'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:36.590398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] The token cache is being invalidate because project d2c01f1be92242118fe13a790f7fdb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:36.591412 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:36.592059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-18c84cbc-8480-4740-be6e-d7d11a7e078b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:36.593606 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1425/2826] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:36 2022] DELETE /identity/v3/projects/d2c01f1be92242118fe13a790f7fdb50 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:36.598929 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.599425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.599545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.618754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:36.619944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:36.628289 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.679902 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1402/2827] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:36.688223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.688515 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.688797 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.709017 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:36.710272 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:36.719041 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1426/2828] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:36.723212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.733401 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe674d-6428-40c5-bc94-6b0fce61377e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.740381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.741395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.741946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.742433 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.743600 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:36.744156 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.747729 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.768947 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1403/2829] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:36.773247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.782737 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75189b7-f357-4f16-ab24-f70f9b38227b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.787400 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.787993 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.788278 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.788550 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.789171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.791094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:36.871347 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1427/2830] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:36 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:36.875500 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:36.885391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c936c-9ef1-4e0e-8ebb-2e1038ce1368 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:36.943615 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:36.944224 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:36.944508 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:36.944783 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:36.945420 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:36.947352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.034483 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1404/2831] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:36 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:37.038783 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.049201 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccee7-7f7b-445a-9aba-7e06bf5d86c8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.054060 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.054664 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.054946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.055223 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.056039 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.058064 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.068180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1428/2832] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:37.072260 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.083383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709d170-30e4-4fda-8988-cbf996fc8b10 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.088111 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb1fa3-e884-40d2-aa9e-3e41319be84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.089010 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb1fa3-e884-40d2-aa9e-3e41319be84e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.089266 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb1fa3-e884-40d2-aa9e-3e41319be84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.089573 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb1fa3-e884-40d2-aa9e-3e41319be84e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.090298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb1fa3-e884-40d2-aa9e-3e41319be84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.091849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb1fa3-e884-40d2-aa9e-3e41319be84e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.102882 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1405/2833] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:37.107740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.117732 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a916b95-23b7-4408-8a96-26c1484ce5e6 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.123268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.123881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.124167 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.124444 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] PATH_INFO: `/v3/projects/5c3e5e36532c4f4cb393b8534990dbdf/users/f8d3ba6a57ab4218a746aaafb6fa6a12/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.139186 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3e5e36532c4f4cb393b8534990dbdf, user_id=f8d3ba6a57ab4218a746aaafb6fa6a12, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.141828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.217727 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1429/2834] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:37 2022] PUT /identity/v3/projects/5c3e5e36532c4f4cb393b8534990dbdf/users/f8d3ba6a57ab4218a746aaafb6fa6a12/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:37.230002 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.230351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.230657 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.259120 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] MFA Rules not processed for user `f8d3ba6a57ab4218a746aaafb6fa6a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:37.260342 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:37.325720 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1406/2835] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:37.336816 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.338582 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:37.400933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b7c3-8a8e-4f3c-a44f-83e628126252 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.404559 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c817435-c180-4a3d-b315-9445acf36c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.405166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c817435-c180-4a3d-b315-9445acf36c71 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.405446 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c817435-c180-4a3d-b315-9445acf36c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.405719 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c817435-c180-4a3d-b315-9445acf36c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.414387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c817435-c180-4a3d-b315-9445acf36c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.415807 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c817435-c180-4a3d-b315-9445acf36c71 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.425238 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1430/2836] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:37.446849 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.456822 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:37.511052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64195cb9-1b70-482b-bff0-d76a120606b7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.515773 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.516398 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.516681 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.516997 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] PATH_INFO: `/v3/users/f8d3ba6a57ab4218a746aaafb6fa6a12` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.518191 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d3ba6a57ab4218a746aaafb6fa6a12)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.520097 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.697226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d3ba6a57ab4218a746aaafb6fa6a12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:37.697948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d3ba6a57ab4218a746aaafb6fa6a12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:37.698494 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d3ba6a57ab4218a746aaafb6fa6a12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:37.705545 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d3ba6a57ab4218a746aaafb6fa6a12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:37.718352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d3ba6a57ab4218a746aaafb6fa6a12'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:37.777826 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1407/2837] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:37 2022] DELETE /identity/v3/users/f8d3ba6a57ab4218a746aaafb6fa6a12 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:37.782472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.782814 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.783036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.802482 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:37.805219 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:37.839377 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:37.864684 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1431/2838] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:37.874960 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:37.886142 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:37.934284 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1729a-e38a-448d-9425-24a8e2050451 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:37.937919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0671-fcf5-4f0d-86c8-cf06207f3edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:37.938525 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0671-fcf5-4f0d-86c8-cf06207f3edd service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:37.938805 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0671-fcf5-4f0d-86c8-cf06207f3edd service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:37.943317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0671-fcf5-4f0d-86c8-cf06207f3edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:37.948829 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0671-fcf5-4f0d-86c8-cf06207f3edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:37.950474 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0671-fcf5-4f0d-86c8-cf06207f3edd service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:37.959794 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1408/2839] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:38.355659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.356148 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:38.367946 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf0c21-f6b7-474f-b80c-92c1e85214ab None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.373372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.374044 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.374327 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.374601 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] PATH_INFO: `/v3/projects/5c3e5e36532c4f4cb393b8534990dbdf` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.375739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3e5e36532c4f4cb393b8534990dbdf)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.377634 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.478363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3e5e36532c4f4cb393b8534990dbdf', 'request_id': 'req-c5664953-2f2e-45a1-b499-a0d3622515b1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:38.483890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3e5e36532c4f4cb393b8534990dbdf', 'request_id': 'req-c5664953-2f2e-45a1-b499-a0d3622515b1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:38.537214 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3e5e36532c4f4cb393b8534990dbdf', 'request_id': 'req-c5664953-2f2e-45a1-b499-a0d3622515b1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:38.548812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] The token cache is being invalidate because project 5c3e5e36532c4f4cb393b8534990dbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:38.549234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:38.549896 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-c5664953-2f2e-45a1-b499-a0d3622515b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:38.551403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1432/2840] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:38 2022] DELETE /identity/v3/projects/5c3e5e36532c4f4cb393b8534990dbdf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:38.556465 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.556793 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.557062 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.578007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:38.579265 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:38.610308 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.643533 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1409/2841] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:38.704922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.705209 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.705484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.725352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:38.726599 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:38.735323 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1433/2842] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:38.739705 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.750183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57118dd-4339-4edc-9553-9e82babb887e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.754892 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.755492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.755771 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.756048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.756696 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:38.757001 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.758662 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.770551 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1410/2843] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:38.774922 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.784384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7acee3-2e3b-4a84-8b32-6ef5b6ecc21d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.789040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.789638 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.789953 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.790234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.790855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.793432 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:38.887604 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1434/2844] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:38.892141 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:38.902486 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f1a4-38c5-4078-90ff-adfedabf4a43 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:38.959128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:38.959738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:38.960019 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:38.960298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:38.960958 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:38.962893 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.068581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1411/2845] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:38 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:39.073951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.092627 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646c812-6cc4-40cf-a45c-f54673c510b5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.100436 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.101452 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.101992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.102501 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.103671 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.107296 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.125600 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1435/2846] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:39.129753 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.140116 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5f33-6be5-4c96-8701-d624558c06ab admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.144651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875460e0-c942-4951-b6d7-c7f0e5b44908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.145242 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875460e0-c942-4951-b6d7-c7f0e5b44908 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.145521 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875460e0-c942-4951-b6d7-c7f0e5b44908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.145791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875460e0-c942-4951-b6d7-c7f0e5b44908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.146470 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875460e0-c942-4951-b6d7-c7f0e5b44908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.148084 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875460e0-c942-4951-b6d7-c7f0e5b44908 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.159346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1412/2847] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:39.163537 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.174232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985632-c4d8-4901-b70d-1d5e47e922ed admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.178768 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.179409 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.179690 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.179963 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] PATH_INFO: `/v3/projects/18daa40f6ef8462faabda63a6e74fb79/users/e4adc9e3320349c686dbae44332c0f73/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.194418 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18daa40f6ef8462faabda63a6e74fb79, user_id=e4adc9e3320349c686dbae44332c0f73, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.197068 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.272402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1436/2848] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:39 2022] PUT /identity/v3/projects/18daa40f6ef8462faabda63a6e74fb79/users/e4adc9e3320349c686dbae44332c0f73/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:39.283270 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.283558 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.283838 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.311946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] MFA Rules not processed for user `e4adc9e3320349c686dbae44332c0f73`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:39.313176 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:39.377905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1413/2849] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:39.389835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:39.391588 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:39.449011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81e66f-a432-422b-a733-850e2910605c admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:39.452659 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854665d-f341-42e0-9162-ae5c608efebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:39.453268 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854665d-f341-42e0-9162-ae5c608efebf service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:39.453549 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854665d-f341-42e0-9162-ae5c608efebf service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:39.453819 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854665d-f341-42e0-9162-ae5c608efebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:39.462298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854665d-f341-42e0-9162-ae5c608efebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:39.464309 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854665d-f341-42e0-9162-ae5c608efebf service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:39.472951 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1437/2850] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:49.374946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:49.468992 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.247531 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.314950 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776ce25-5771-4014-9969-7552b6eea811 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.319548 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.320183 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.320467 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.320745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] PATH_INFO: `/v3/users/e4adc9e3320349c686dbae44332c0f73` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.321907 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4adc9e3320349c686dbae44332c0f73)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.324423 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.468228 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4adc9e3320349c686dbae44332c0f73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.468936 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4adc9e3320349c686dbae44332c0f73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.469562 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4adc9e3320349c686dbae44332c0f73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.477105 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4adc9e3320349c686dbae44332c0f73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.489750 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4adc9e3320349c686dbae44332c0f73'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.551475 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1414/2851] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:54 2022] DELETE /identity/v3/users/e4adc9e3320349c686dbae44332c0f73 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:54.555996 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.556481 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.556597 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.575959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:54.577168 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.635235 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1438/2852] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:54.645059 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.646501 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.705026 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d79ec-ee29-4ef2-9fb5-8d3158803a6c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.708673 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b1319-9ca8-47cb-acc8-c3a86509bb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.709274 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b1319-9ca8-47cb-acc8-c3a86509bb75 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.709554 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b1319-9ca8-47cb-acc8-c3a86509bb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.709827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b1319-9ca8-47cb-acc8-c3a86509bb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.719397 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b1319-9ca8-47cb-acc8-c3a86509bb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.720754 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b1319-9ca8-47cb-acc8-c3a86509bb75 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.730416 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1415/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:55.206901 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.208404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.221247 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f0a1a-0aac-4f75-8652-c410c6d6c085 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.226105 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.226739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.227021 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.227302 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] PATH_INFO: `/v3/projects/18daa40f6ef8462faabda63a6e74fb79` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.228964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18daa40f6ef8462faabda63a6e74fb79)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.230956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.343172 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18daa40f6ef8462faabda63a6e74fb79', 'request_id': 'req-37ba966f-f9b3-472c-a950-f0bf9c040c49'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.348985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18daa40f6ef8462faabda63a6e74fb79', 'request_id': 'req-37ba966f-f9b3-472c-a950-f0bf9c040c49'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.439613 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18daa40f6ef8462faabda63a6e74fb79', 'request_id': 'req-37ba966f-f9b3-472c-a950-f0bf9c040c49'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.451279 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] The token cache is being invalidate because project 18daa40f6ef8462faabda63a6e74fb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:55.451575 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.452248 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-37ba966f-f9b3-472c-a950-f0bf9c040c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.453738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1439/2854] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:55 2022] DELETE /identity/v3/projects/18daa40f6ef8462faabda63a6e74fb79 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:55.458760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.460648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.460648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.480237 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:55.481429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.498154 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.539923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1416/2855] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:55.549796 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.550094 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.550373 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.570202 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:55.571410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.580897 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1440/2856] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:55.583713 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.595354 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8124-72ba-4a7d-b611-4a4201dbe28f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.601386 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.602202 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.602492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.602766 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.604126 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:55.604430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.606052 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.619172 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1417/2857] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:55.623703 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.632954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db0a02-3881-44dd-9b81-f8f00451b1cf None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.637686 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.638324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.638602 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.638873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.639516 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.641404 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.744097 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1441/2858] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:55.748268 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.758346 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538358cc-0dc3-44d0-90b6-c9119e7df918 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.815503 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.816119 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.816402 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.816678 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.817352 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.819317 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.897081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1418/2859] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:55.901743 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.912118 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9a928-2d42-4e95-a865-0d9a8178ed05 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.917392 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.931151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.931151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.931151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.931151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.931151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.931151 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1442/2860] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:55.935241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.945770 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07b28-f410-4e54-b6d2-9924c7c4d8a2 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.950919 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6182a33-8e8e-48a8-8090-135268cf7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.951512 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6182a33-8e8e-48a8-8090-135268cf7bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.951789 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6182a33-8e8e-48a8-8090-135268cf7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.952056 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6182a33-8e8e-48a8-8090-135268cf7bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.952683 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6182a33-8e8e-48a8-8090-135268cf7bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.954309 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6182a33-8e8e-48a8-8090-135268cf7bdd admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.965430 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1419/2861] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:55.969514 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.979832 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6612345-90d9-4aab-896f-2c97044c243f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.984335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.984974 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.985254 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.985528 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] PATH_INFO: `/v3/projects/0b8eeececb284a7f8de0922f3a4430e7/users/3314cdfd07db4b46855f487036474574/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.000142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8eeececb284a7f8de0922f3a4430e7, user_id=3314cdfd07db4b46855f487036474574, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.003195 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.085217 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1443/2862] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:55 2022] PUT /identity/v3/projects/0b8eeececb284a7f8de0922f3a4430e7/users/3314cdfd07db4b46855f487036474574/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:56.096572 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.098151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.098151 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.126048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] MFA Rules not processed for user `3314cdfd07db4b46855f487036474574`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:56.129217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:56.192180 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1420/2863] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:47:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:56.203696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.205368 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:56.227961 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:56.266164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf6a1c-5b3e-43fa-87be-6ac3338dd411 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.269716 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd931dc-be8a-4ad4-9585-89f6458eb445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.270723 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd931dc-be8a-4ad4-9585-89f6458eb445 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.271047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd931dc-be8a-4ad4-9585-89f6458eb445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.271320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd931dc-be8a-4ad4-9585-89f6458eb445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.279750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd931dc-be8a-4ad4-9585-89f6458eb445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.281253 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd931dc-be8a-4ad4-9585-89f6458eb445 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.289828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1444/2864] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:00.323897 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.343241 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:00.388325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696550c-8e37-4911-96e5-95be88411e59 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.393077 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.393701 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.394012 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.394286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] PATH_INFO: `/v3/users/3314cdfd07db4b46855f487036474574` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.395409 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3314cdfd07db4b46855f487036474574)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.397298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.565160 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3314cdfd07db4b46855f487036474574'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:00.565736 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3314cdfd07db4b46855f487036474574'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:00.566374 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3314cdfd07db4b46855f487036474574'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:00.574090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3314cdfd07db4b46855f487036474574'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:00.585948 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3314cdfd07db4b46855f487036474574'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:00.661764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1421/2865] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:48:00 2022] DELETE /identity/v3/users/3314cdfd07db4b46855f487036474574 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:48:00.666280 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.666787 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.666890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.685964 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:00.687224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:00.747220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1445/2866] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:00.756886 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:00.758381 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:00.817014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027ab8d-52e5-4faa-b138-7ffbdd5e362f admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:00.820599 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5372db4-ed0b-404d-9f37-605437fd4752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:00.821216 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5372db4-ed0b-404d-9f37-605437fd4752 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:00.821564 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5372db4-ed0b-404d-9f37-605437fd4752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:00.822454 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5372db4-ed0b-404d-9f37-605437fd4752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:00.832434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5372db4-ed0b-404d-9f37-605437fd4752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:00.834079 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5372db4-ed0b-404d-9f37-605437fd4752 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:00.844818 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1422/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:01.253211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.254650 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:01.269403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073f3e4-0b62-4480-9673-fcdc2ef2a261 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.274365 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.275363 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.275873 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.276274 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] PATH_INFO: `/v3/projects/0b8eeececb284a7f8de0922f3a4430e7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.277439 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8eeececb284a7f8de0922f3a4430e7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.279777 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.377164 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8eeececb284a7f8de0922f3a4430e7', 'request_id': 'req-51064e5f-159d-4bac-b6ae-50bc6fb45daa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:01.382890 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8eeececb284a7f8de0922f3a4430e7', 'request_id': 'req-51064e5f-159d-4bac-b6ae-50bc6fb45daa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:01.448324 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8eeececb284a7f8de0922f3a4430e7', 'request_id': 'req-51064e5f-159d-4bac-b6ae-50bc6fb45daa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:01.459886 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] The token cache is being invalidate because project 0b8eeececb284a7f8de0922f3a4430e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:48:01.460171 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:01.460792 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-51064e5f-159d-4bac-b6ae-50bc6fb45daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:01.462900 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1446/2868] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:48:01 2022] DELETE /identity/v3/projects/0b8eeececb284a7f8de0922f3a4430e7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:01.467966 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.468518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.468518 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.488724 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:01.489946 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:01.522764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:01.549024 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1423/2869] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:01.556803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.558828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.558828 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.579459 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:01.580711 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:01.589483 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1447/2870] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:01.599928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.605304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee38a10-91f9-427c-bf4d-85a28e730aa8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.610047 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.610647 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.610928 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.611245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.611938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:01.612240 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.613827 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.626304 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1424/2871] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:01.630724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.640310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9da8e-60a8-46dc-9775-b041abcf86c1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.644977 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.645557 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.645835 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.646142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.646757 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.648636 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:01.827336 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1448/2872] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:48:01 2022] POST /identity/v3/projects => generated 391 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:01.831644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:01.842514 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1944bc5-d01f-4188-b60f-38827b01cbc8 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:01.905213 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:01.905831 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:01.906247 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:01.906493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:01.907123 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:01.909022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.015267 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1425/2873] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:01 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:02.019430 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.030410 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4faac-865f-42bc-85a4-553956feecb5 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.035866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.035866 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.036110 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.036212 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.036840 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.038474 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.048649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1449/2874] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:02.052723 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.063280 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19a5a6-87ac-4cc7-b4bf-f61114534e8c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.068014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97333857-997e-46a2-9884-a5d1934c43da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.068617 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333857-997e-46a2-9884-a5d1934c43da admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.068900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333857-997e-46a2-9884-a5d1934c43da admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.069175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333857-997e-46a2-9884-a5d1934c43da admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.069900 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97333857-997e-46a2-9884-a5d1934c43da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.074064 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97333857-997e-46a2-9884-a5d1934c43da admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.082906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1426/2875] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:02.087180 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.098526 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297048-b24b-4716-a80b-44796c482496 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.103471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.104139 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.104450 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.104739 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] PATH_INFO: `/v3/projects/715fd840a7f8469296d190f280d3adbf/users/f0d5ac2363364209959be6fa86234129/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.107242 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:02.121047 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715fd840a7f8469296d190f280d3adbf, user_id=f0d5ac2363364209959be6fa86234129, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.123858 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.200655 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1450/2876] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:48:02 2022] PUT /identity/v3/projects/715fd840a7f8469296d190f280d3adbf/users/f0d5ac2363364209959be6fa86234129/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:02.212899 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.213206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.213448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.242011 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] MFA Rules not processed for user `f0d5ac2363364209959be6fa86234129`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:02.243223 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:02.310286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1427/2877] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:48:02.321019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:02.323069 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:02.380054 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd39c-8b12-4425-a10c-b39c45c736a8 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:02.383657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546e57d-5b64-4276-ac02-5fde1fadc9c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:02.384259 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e57d-5b64-4276-ac02-5fde1fadc9c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:02.384542 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e57d-5b64-4276-ac02-5fde1fadc9c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:02.384812 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e57d-5b64-4276-ac02-5fde1fadc9c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:02.393048 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546e57d-5b64-4276-ac02-5fde1fadc9c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:02.394500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546e57d-5b64-4276-ac02-5fde1fadc9c4 service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:02.403679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1451/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:12.307331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:12.399772 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.884429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.945396 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517dca2-e119-43d1-931a-d2a0dd540a98 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.950802 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.951441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.951725 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.952005 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] PATH_INFO: `/v3/users/f0d5ac2363364209959be6fa86234129` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.953189 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d5ac2363364209959be6fa86234129)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.955185 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:14.177909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d5ac2363364209959be6fa86234129'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:14.178528 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d5ac2363364209959be6fa86234129'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:14.179149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d5ac2363364209959be6fa86234129'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:14.186006 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d5ac2363364209959be6fa86234129'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:14.198535 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d5ac2363364209959be6fa86234129'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:14.295622 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1428/2879] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:48:13 2022] DELETE /identity/v3/users/f0d5ac2363364209959be6fa86234129 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:14.300724 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.301211 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.301320 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.321346 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:14.323554 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:14.382495 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1452/2880] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:14.393071 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:14.394556 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:14.453571 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f342-6854-41ff-9627-9ee8f35e98b1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:14.457014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d88c05-05d8-4188-b503-fdb744ec5d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.457635 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88c05-05d8-4188-b503-fdb744ec5d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.457938 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88c05-05d8-4188-b503-fdb744ec5d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.458212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d88c05-05d8-4188-b503-fdb744ec5d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.467540 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88c05-05d8-4188-b503-fdb744ec5d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:14.468954 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d88c05-05d8-4188-b503-fdb744ec5d7f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:14.478441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1429/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:14.861354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:14.862941 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:14.876166 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844f2d0-c6df-4e7c-bc49-b8c4a2841295 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:14.881708 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:14.882396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:14.882898 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:14.883230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] PATH_INFO: `/v3/projects/715fd840a7f8469296d190f280d3adbf` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:14.884398 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715fd840a7f8469296d190f280d3adbf)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:14.886402 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.001934 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715fd840a7f8469296d190f280d3adbf', 'request_id': 'req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:15.007345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715fd840a7f8469296d190f280d3adbf', 'request_id': 'req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:15.084011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715fd840a7f8469296d190f280d3adbf', 'request_id': 'req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:15.096197 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] The token cache is being invalidate because project 715fd840a7f8469296d190f280d3adbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:48:15.096492 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:15.097403 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-f793ffd5-7a9b-4cce-b6fd-e9b02436a0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:15.098927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1453/2882] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:48:14 2022] DELETE /identity/v3/projects/715fd840a7f8469296d190f280d3adbf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:15.105383 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.105898 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.106014 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.125837 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:15.127098 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:15.144102 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:15.187495 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1430/2883] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:48:15.195420 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.195769 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.196127 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.216658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:15.217970 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:15.226480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1454/2884] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:48:15.231708 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.241492 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137663ef-b63d-4b81-a81e-d1859b9195c4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.246557 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.247203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.247488 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.247922 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.248578 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:15.248921 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.250568 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.262549 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1431/2885] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:15.266893 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.276698 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e67d-c4ee-462b-b7ba-6055f23ed0c2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.281394 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.282341 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.282484 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.282662 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.283298 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.285241 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.368799 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1455/2886] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:48:15 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:48:15.373053 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.382951 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac067d-e77c-414d-a319-8816f47ca187 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.439751 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.440391 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.440707 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.440987 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.441613 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.443581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.513624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1432/2887] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:15 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:15.517507 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.528762 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831234-2272-4045-b908-ff8103227c2b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.533921 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.534593 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.534880 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.535154 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.535803 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.537401 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.547629 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1456/2888] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:15.551804 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.562171 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721c732-a2b3-49d0-8599-97d33c47cc42 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.566825 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4ad9-6af0-428e-8ee0-2aac39eec7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.567429 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4ad9-6af0-428e-8ee0-2aac39eec7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.567711 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4ad9-6af0-428e-8ee0-2aac39eec7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.567985 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4ad9-6af0-428e-8ee0-2aac39eec7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.568623 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4ad9-6af0-428e-8ee0-2aac39eec7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.570286 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4ad9-6af0-428e-8ee0-2aac39eec7dc admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.581537 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1433/2889] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:15.585722 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.596471 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf0a5-6814-4716-9da0-b8896cdd4b19 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.601384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.602071 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.602352 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.602626 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] PATH_INFO: `/v3/projects/408513edf6254bffb291d0d86a864539/users/0e71944e3b204549927fdbe4f82d25c3/roles/2ffdbc0543fc4f02ae9144d11b210885` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.617440 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408513edf6254bffb291d0d86a864539, user_id=0e71944e3b204549927fdbe4f82d25c3, role_id=2ffdbc0543fc4f02ae9144d11b210885)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.620293 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.682408 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1457/2890] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:48:15 2022] PUT /identity/v3/projects/408513edf6254bffb291d0d86a864539/users/0e71944e3b204549927fdbe4f82d25c3/roles/2ffdbc0543fc4f02ae9144d11b210885 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:15.687612 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45c0c-bb8f-41ec-8a4e-5ec642e1f60c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.687906 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45c0c-bb8f-41ec-8a4e-5ec642e1f60c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.688184 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45c0c-bb8f-41ec-8a4e-5ec642e1f60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.707532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-49b45c0c-bb8f-41ec-8a4e-5ec642e1f60c None None] MFA Rules not processed for user `07fe569d9cd046878133757fe1ce9618`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:15.708739 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-49b45c0c-bb8f-41ec-8a4e-5ec642e1f60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:15.770763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1434/2891] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:15.780297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:15.782020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:15.804697 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:15.844933 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffd4d6-4db1-4271-8ac7-fa21180cf316 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:15.848648 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:15.849257 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:15.851894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:15.851894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:15.859276 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:15.860710 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:15.870825 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1458/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:21.129325 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.129962 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.130081 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.160722 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] MFA Rules not processed for user `0e71944e3b204549927fdbe4f82d25c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:21.162013 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:21.181546 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:21.236941 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1435/2893] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:21.241539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.251010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775c3a1-dd05-410d-ba3f-4e7c13cfb37b service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.255595 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.256189 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.256470 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.256749 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.257384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.259480 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.351824 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1459/2894] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 24 09:48:21 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:21.356298 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.367206 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc0173-ef73-407d-91a6-f0daf6c66b0f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.428149 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.428782 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.429094 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.429370 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.430058 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.432048 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.518637 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1436/2895] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:21 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:21.522795 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.538927 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c175a6-6c77-4276-aa51-3dfdb40779ba admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.543778 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.544393 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.544679 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.545092 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.545764 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.547490 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.558386 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1460/2896] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:21.562648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.573581 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623c35b-aa2f-4dd7-b3b5-bf5d1f468db5 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.578425 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.579099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.579384 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.579665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] PATH_INFO: `/v3/projects/154e742811f64f7da4d133bbdeda2a25/users/7a11498987894fc88808880d89fa96a8/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.596986 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154e742811f64f7da4d133bbdeda2a25, user_id=7a11498987894fc88808880d89fa96a8, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.599677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.661674 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1437/2897] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:48:21 2022] PUT /identity/v3/projects/154e742811f64f7da4d133bbdeda2a25/users/7a11498987894fc88808880d89fa96a8/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:21.666059 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.676169 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1f636-365a-44f7-b684-c50e72279665 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.743024 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2d5c2-6076-479f-9e18-e7f3549c3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.743657 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d5c2-6076-479f-9e18-e7f3549c3b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.743940 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d5c2-6076-479f-9e18-e7f3549c3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.744215 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2d5c2-6076-479f-9e18-e7f3549c3b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.744864 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d5c2-6076-479f-9e18-e7f3549c3b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.746534 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2d5c2-6076-479f-9e18-e7f3549c3b10 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.760726 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1461/2898] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:48:21.761965 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:21.772369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915934-6790-4d21-9d9b-de37a99f4f06 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:21.777373 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:21.778135 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:21.778479 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:21.778816 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] PATH_INFO: `/v3/projects/154e742811f64f7da4d133bbdeda2a25/users/7a11498987894fc88808880d89fa96a8/roles/a869e27f1a774ce0988b7fb510c999a0` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:21.780832 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154e742811f64f7da4d133bbdeda2a25, user_id=7a11498987894fc88808880d89fa96a8, role_id=a869e27f1a774ce0988b7fb510c999a0)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:21.783561 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:21.795090 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1438/2899] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 24 09:48:21 2022] PUT /identity/v3/projects/154e742811f64f7da4d133bbdeda2a25/users/7a11498987894fc88808880d89fa96a8/roles/a869e27f1a774ce0988b7fb510c999a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:27.248500 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4743c-f9a6-4bf8-9c10-1cf79248b917 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:27.249015 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4743c-f9a6-4bf8-9c10-1cf79248b917 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:27.249224 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4743c-f9a6-4bf8-9c10-1cf79248b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:27.281539 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5ad4743c-f9a6-4bf8-9c10-1cf79248b917 None None] MFA Rules not processed for user `7a11498987894fc88808880d89fa96a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:27.282839 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5ad4743c-f9a6-4bf8-9c10-1cf79248b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:27.363705 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1462/2900] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:27.380078 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:27.381905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:27.461945 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:27.480229 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9de40d-f7db-4e73-afb0-9a4f8010a231 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:27.485972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:27.486618 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:27.486923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:27.487330 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:27.552450 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:27.554859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:27.567949 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1439/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:29.972738 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:29.973678 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:29.974018 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:29.994504 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] MFA Rules not processed for user `0e71944e3b204549927fdbe4f82d25c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:29.995718 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:30.003027 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1463/2902] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 24 09:48:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:37.580737 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=29 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:39.989506 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:43.509956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:43.515351 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:43.569145 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6df7e7-41eb-41c8-aa42-ce9e08bf9d61 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:43.573030 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af46b3972c53418e8932620410454643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:43.573644 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:43.573964 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:43.574245 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:43.576338 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:43.590968 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:43.592348 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:43.604434 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1440/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:44.657912 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:44.659384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:44.667158 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:44.668745 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:44.729910 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d0cd6-8248-4f86-b308-ab9b7633ca2c service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:44.732081 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92c11a-a97b-4c11-8c46-1c163b0cb250 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:44.733790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:44.734441 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:44.734730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:44.735007 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:44.736760 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:44.737046 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:44.737649 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:44.737956 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:44.738230 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:44.739891 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:44.752022 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:44.752233 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:44.753880 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:44.754052 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:44.764881 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1464/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:44.765763 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1441/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:48:48.144707 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:48.157387 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ed3a-3069-4286-b3c1-1fc67b306f2d service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:48.165095 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:48.166310 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:48.166841 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:48.167384 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:48.170585 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:48.184487 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:48.186142 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:48.196356 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1465/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:48.958124 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:48.970629 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b095-28e7-4014-b0c1-6bec539ca488 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:48.977791 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:48.978464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:48.978730 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:48.979003 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:48.980790 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:48.994468 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:48.995666 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:49.007703 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1442/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:53.737416 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:53.738855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:53.755731 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615704c9-cefc-47ba-a6bc-8bc0481e6b70 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:53.761419 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:53.762056 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:53.762339 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:53.762609 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:53.764313 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:53.777240 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:53.778855 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:53.791372 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1466/2908] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:48:56.772648 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:56.782085 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415672-a250-4e89-970d-815cf5cd6116 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:56.785704 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:56.786347 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:56.786634 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:56.786911 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:56.796740 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:56.798208 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:56.808099 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1443/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:58.970141 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:58.982304 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad334b-9485-4e09-a466-b6a7942f2462 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:58.988378 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63691cb1f90744c497aaddd6139d5e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:58.989011 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:58.989425 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:58.989715 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:58.991820 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:59.004988 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:59.007637 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:59.019010 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1467/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:49:06.803944 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=64 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:09.014181 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=50 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:08.101878 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:08.110863 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af927bad-a061-48bd-be10-d7d5d01469de service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:08.114532 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:08.115128 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:08.115405 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:08.115675 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:08.117411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:08.128428 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:08.129843 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:08.138596 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1444/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:09.602354 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:09.613375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0b3b1-9961-4215-a78d-b90d3a87184a service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:09.617063 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:09.617666 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:09.617980 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:09.618287 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:09.620040 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:09.631220 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:09.632658 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:09.642759 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1468/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:10.744331 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:10.754413 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a1e10-d122-4f30-a6cb-df623bb4e173 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:10.758209 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '072c1d4765474a91b9ceca1727432fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:10.758909 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:10.759092 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:10.759369 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:10.761134 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:10.776841 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:10.778624 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:10.790859 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1445/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:15.646374 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.647740 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:15.663375 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13e10-2065-429d-ad0a-bef7b3cf191d service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.668297 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.669533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.669821 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.670125 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.671801 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:15.683260 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.685538 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.695335 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1469/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:20.785211 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=12 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:25.691178 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=12 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:41.824195 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:41.837157 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e0adb-d30a-4d61-bbbb-65f44beb0106 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:41.843426 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:41.844212 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:41.844493 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:41.844764 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:41.846842 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:41.859175 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:41.860738 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:41.873608 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1446/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:45.472344 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.487290 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14193c87-eb5c-4092-ab2e-74b4888eaa1f service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.493311 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.493950 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.494234 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.494508 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.496288 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:45.508345 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.509959 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.520761 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1470/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:45.609625 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:45.674808 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a2874-d0b7-4a53-9d13-d23215b987ce service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:45.679526 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:45.680161 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:45.680448 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:45.680726 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] PATH_INFO: `/v3/users/0e71944e3b204549927fdbe4f82d25c3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:45.681980 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e71944e3b204549927fdbe4f82d25c3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:45.684464 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:45.897440 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e71944e3b204549927fdbe4f82d25c3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:45.898222 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e71944e3b204549927fdbe4f82d25c3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:45.898858 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e71944e3b204549927fdbe4f82d25c3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:45.906627 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e71944e3b204549927fdbe4f82d25c3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:45.918651 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e71944e3b204549927fdbe4f82d25c3'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.015567 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1447/2917] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:52:45 2022] DELETE /identity/v3/users/0e71944e3b204549927fdbe4f82d25c3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:46.275002 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.287158 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5ef6f-78d5-47e2-bc68-2e933c39525c service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.350847 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.351472 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.351750 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.352020 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] PATH_INFO: `/v3/projects/408513edf6254bffb291d0d86a864539` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.353117 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=408513edf6254bffb291d0d86a864539)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.355036 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.445249 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408513edf6254bffb291d0d86a864539', 'request_id': 'req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.450867 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408513edf6254bffb291d0d86a864539', 'request_id': 'req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.556894 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408513edf6254bffb291d0d86a864539', 'request_id': 'req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.569696 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] The token cache is being invalidate because project 408513edf6254bffb291d0d86a864539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:52:46.570019 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.570687 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.572205 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1471/2918] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:52:46 2022] DELETE /identity/v3/projects/408513edf6254bffb291d0d86a864539 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:46.576487 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:46.577905 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:46.591366 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3afb2d-3d16-401a-904c-cc531c0f680e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:46.649275 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:46.649984 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:46.650203 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:46.650481 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] PATH_INFO: `/v3/users/7a11498987894fc88808880d89fa96a8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:46.651616 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a11498987894fc88808880d89fa96a8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:46.654200 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:46.659721 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:46.862677 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a11498987894fc88808880d89fa96a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.863359 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a11498987894fc88808880d89fa96a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.863972 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a11498987894fc88808880d89fa96a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.870864 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a11498987894fc88808880d89fa96a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.883395 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a11498987894fc88808880d89fa96a8'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:46.982620 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1448/2919] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 24 09:52:46 2022] DELETE /identity/v3/users/7a11498987894fc88808880d89fa96a8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:47.210920 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:47.212353 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:47.227985 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1af0a9-2e3d-4ef9-b097-8d31cc8f13aa admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:47.287624 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fe569d9cd046878133757fe1ce9618', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '808b3dabc5b4438aaacc878cdfe73e11', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:47.288258 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:47.288533 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:47.288808 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] PATH_INFO: `/v3/projects/154e742811f64f7da4d133bbdeda2a25` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:47.289954 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=154e742811f64f7da4d133bbdeda2a25)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:47.291887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:47.312887 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:47.439543 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154e742811f64f7da4d133bbdeda2a25', 'request_id': 'req-ea414a7f-441e-4a39-9111-5c885183cbdc'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:47.445396 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154e742811f64f7da4d133bbdeda2a25', 'request_id': 'req-ea414a7f-441e-4a39-9111-5c885183cbdc'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:47.530232 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154e742811f64f7da4d133bbdeda2a25', 'request_id': 'req-ea414a7f-441e-4a39-9111-5c885183cbdc'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:47.541997 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] The token cache is being invalidate because project 154e742811f64f7da4d133bbdeda2a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:52:47.545837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:47.545837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-ea414a7f-441e-4a39-9111-5c885183cbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:47.545837 dv-cinder-854269-2-smb devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1472/2920] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 24 09:52:47 2022] DELETE /identity/v3/projects/154e742811f64f7da4d133bbdeda2a25 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:56.978226 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:57.539008 dv-cinder-854269-2-smb devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:11.868461 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:11.869940 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:12.008217 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89807c-0056-4307-bc35-5e13ffc7785c admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:12.066411 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ae3f2f0b014430e8fb19ad7316b75c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b444e8775cb144ad8413d4571770f098', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:12.067017 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:12.067668 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:12.067956 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:12.069665 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:12.081392 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:12.082923 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a0d23-5c6a-487d-ae81-929e9dbe9a2c service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:12.093328 dv-cinder-854269-2-smb devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1449/2921] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:22.088749 dv-cinder-854269-2-smb devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=89 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}